IN_Senior Associate_Azure Data Engineer_Data and Analytics_Advisory_Hyderabad

Responsibilities: 

• Develop, implement, and maintain enterprise-wide data governance policies, procedures, and standards within the Azure ecosystem.
• Leverage Azure Purview to manage data catalogs, lineage, classification, and metadata across multiple data sources.
• Design and implement data access controls, data stewardship models, and compliance monitoring using Databricks Unity Catalog.
• Build and maintain data quality and validation frameworks using PySpark, Python, and SQL within Azure Databricks environments.
• Collaborate with engineering teams to embed governance standards into data pipelines and workflows.
• Monitor adherence to data governance policies and regulatory compliance (e.g., GDPR, HIPAA) leveraging Azure and Databricks tools.
• Utilize Databricks Genie or similar orchestration tools for automated workflow scheduling and job monitoring with governance checks.
• Develop dashboards, reports, and alerts to track key data governance metrics and incidents.
• Conduct training and awareness sessions to enhance data governance literacy across the organization.
• Work across cross-functional teams including legal, security, risk, and business units to align governance strategies.
• Stay current with emerging trends and best practices in data governance and cloud data platforms.

Required Skills & Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Data Science, Information Systems, or a related discipline.
• 5+ years of experience in data governance, data management, or data engineering roles within Azure-based environments.
• Strong hands-on experience with Azure Purview for data cataloging, metadata management, and lineage tracking.
• Proficiency in Databricks Unity Catalog to enforce fine-grained access control, data classification, and policy enforcement.
• Expertise in developing data workflows and governance automation using PySpark, Python, and SQL on Azure Databricks.
• Solid understanding of data governance principles, data privacy regulations, and compliance frameworks.
• Some exposure to Databricks Genie or similar orchestration/scheduling tools.
• Experience collaborating with data stewards, data owners, security teams, and compliance officers.
• Strong analytical, documentation, and communication skills.

Preferred Qualifications:

• Azure certifications such as Azure Data Engineer Associate or Azure Security Engineer.
• Familiarity with Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics.
• Knowledge of DevOps and CI/CD pipelines in data governance automation.
• Awareness or experience with LangGraph for integrating language models with data governance and knowledge graph processes is a plus.

What We Offer:

• Competitive salary and comprehensive benefits.
• Opportunity to lead critical data governance initiatives on cloud platforms.
• Collaborative and innovative work environment.
• Opportunities for professional growth and learning.

Mandatory skill sets: 

PySpark, Python, and SQL within Azure Databricks environments.Azure Purview 

Preferred skill sets: 

Databricks Genie 

Years of experience required: 

4-7 Years

Education qualification: 

• B.E,B.Tech, MCA,M.E,M.Tech