Data Engineer

Databricks Data Architect – Manager

Location: Bengaluru, India
Employment Type: Full-time
Reporting To: Jagadish Doki
Organization: KPMG Global Services (KGS)

About KPMG Global Services (KGS)

KPMG Global Services (KGS), established in India in 2008, is a strategic global delivery organization supporting over 50 KPMG member firms worldwide. With close to 10,000 professionals across Bengaluru, Gurugram, Kochi, and Pune, KGS delivers high‑impact Advisory and Tax services through a scalable and customized delivery model. As part of KPMG in India, KGS is consistently recognized as a top employer for inclusion, diversity, and workplace culture.

Team Overview

KPMG’s Data & Analytics practice helps clients unlock business value through trusted, high‑quality analytics solutions. The team takes a business‑first approach to solving complex challenges across growth, risk, and performance. Professionals within this practice work at the intersection of data engineering, cloud platforms, and advanced analytics, enabling data‑driven decision‑making at scale. 

Role Summary

The Databricks Data Architect – Manager will play a critical leadership role in designing, building, and scaling enterprise‑grade data platforms using Databricks on Azure. This role is responsible for architecting robust data ingestion and transformation frameworks, enabling secure and governed data lakes, supporting cloud migration programs, and providing technical leadership across large, complex data engineering initiatives.

The role combines deep hands‑on expertise, solution architecture, and stakeholder engagement, making it ideal for a senior data engineering leader who can translate business objectives into scalable technical solutions while mentoring teams and driving best practices

Key Responsibilities

• Architect, design, and deliver scalable data platforms using Azure Databricks, Apache Spark, and Delta Lake.
• Build and optimize end‑to‑end data ingestion, processing, and transformation pipelines for large, complex datasets from multiple sources.
• Develop reusable and standardized frameworks to improve performance, reliability, and maintainability of data engineering workloads.
• Lead and support cloud migration initiatives, including modernization of legacy data platforms to Databricks and Azure‑native services.
• Implement data security, governance, and privacy controls, ensuring compliance with enterprise and regulatory standards.
• Monitor, troubleshoot, and performance‑tune Databricks workloads with a focus on cost and compute efficiency.
• Collaborate closely with business stakeholders, analytics teams, and cross‑functional technology teams to ensure data quality and availability.
• Provide technical thought leadership, including defining architecture standards, patterns, and Best Practices for Databricks adoption.
• Deliver proofs of concept (PoCs) and solution demos to showcase Databricks capabilities to stakeholders and clients.
• Mentor and guide data engineers, promoting high engineering standards and continuous improvement. 

Mandatory Skills & Experience

• Bachelor’s or higher degree in Computer Science, Information Technology, or related discipline, with 9+ years of overall experience.
• Extensive hands‑on experience with Databricks and Apache Spark, including PySpark, SQL, and Scala.
• Strong expertise in designing large‑scale data ingestion and transformation pipelines.
• Proven experience working with Azure services, including Azure Databricks, Azure Data Lake Storage, and Azure Blob Storage.
• Solid understanding of cloud architectures and data engineering migration methodologies.
• Experience implementing CI/CD and DevSecOps practices in Databricks environments.
• Knowledge of big data file formats such as Parquet and Avro, along with compression techniques.
• Strong communication skills with the ability to explain complex technical concepts to both technical and non‑technical audiences.
• Demonstrated ability to work independently, take ownership, and drive outcomes.

Preferred Qualifications

• Hands‑on experience with Azure DevOps, Terraform, and Microsoft VSTS.
• Experience integrating Databricks with Azure Data Factory for orchestration.
• Familiarity with Power BI for analytics and reporting use cases.
• Understanding of Azure RBAC and IAM concepts for securing data platforms.
• Relevant certifications such as Databricks Certified Data Engineer or DP‑203: Data Engineering on Microsoft Azure.
• Exposure to AI/ML workloads and their integration with Databricks platforms.

Culture & Benefits

KPMG offers a collaborative, inclusive, and growth‑oriented environment with benefits that support personal and professional well‑being, including parental leave, CSR initiatives, networking opportunities, and employee development programs. Benefits may vary by role and location.