Associate Principal - Architecture

Associate Principal - Architecture

RR created as per Heera Alva s mail PG proactive RR creation

DO NOT CHANGE CUSTOMER NAME PG PROACTIVE HIRE

Data Platform Architecture

Design endtoend cloudnative data platforms using Azure services

Design scalable Lakehouse architectures using Azure Databricks and Delta Lake

Establish enterprise data standards and architecture governance

Azure Databricks Leadership

Architect Databricks workspaces and multienvironment deployments

Define best practices for cluster management autoscaling job orchestration and workload optimization

Implement Delta Lake and Medallion Architecture Bronze Silver Gold

Drive migration of legacy ETL workloads to Databricks

Data Governance Security

Implement Unity Catalog for centralized governance

Define RBAC data access controls and rowcolumnlevel security

Design secure integrations with Key Vault Managed Identity

Ensure compliance with enterprise security standards

Data Engineering Optimization

Review and optimize PySpark code for performance

Implement partitioning ZOrdering Liquid Clustering caching and query optimization techniques

Establish monitoring and observability frameworks

Drive FinOps initiatives to optimize Databricks and Azure consumption

Integration Orchestration

Architect data ingestion frameworks using Azure Data Factory

Design integrations with SQL Server SAP Oracle APIs Salesforce Data Lakes and thirdparty systems

Implement CICD frameworks using Azure DevOps

Leadership Stakeholder Management

Collaborate with business stakeholders product owners architects and engineering teams

Conduct architecture reviews and technical governance sessions

Mentor Data Engineers and Technical Leads

Drive technical roadmap and modernization initiatives

Required Skills

Azure Services

Azure Databricks

Azure Data Factory ADF

Azure Data Lake Storage Gen2 ADLS

Azure Key Vault

Azure Monitor

Azure DevOps

Databricks Expertise

Delta Lake

Unity Catalog

Databricks Workflows

Cluster Policies

Delta Live Tables DLT

Databricks Asset Bundles

Structured Streaming

Programming Data

PySpark

Python

SQL

Spark Optimization

Data Modeling

Data Warehousing Concepts

Architecture

Lakehouse Architecture

Medallion Architecture

Data Governance

Data Security

High Availability Disaster Recovery

Enterprise Integration Patterns

Preferred Skills

Databricks Certified Data Engineer Professional

Databricks Certified Data Engineer Associate

Azure Solutions Architect Expert

Azure Data Engineer Associate

Experience in FMCG Retail Manufacturing Healthcare or Banking domains

Exposure to Generative AI and Data AI platforms

MustHave Experience

13 years of Data Engineering experience

5 years of Azure Databricks implementation experience

Experience designing enterprisescale Lakehouse architectures

Handson experience with Unity Catalog implementation

Strong expertise in PySpark optimization and performance tuning

Experience with Azure DevOps CICD pipelines

Experience leading technical teams and architecture decisions