Senior - Big Data

Senior - Big Data

About KPMG in India

KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada. 

KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-enabled services, which reflect a shared knowledge of global and local industries and our experience of the Indian business environment.

Your Responsibilities

• Design and develop scalable data pipelines using Apache Spark and Scala

• Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)

• Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure

• Write clean, modular Scala code using functional programming principles

• Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes

• Ensure code quality, documentation, and CI/CD practices are followed

Must-Have Skills

• 3+ years of experience with Apache Spark in Scala

• Deep understanding of Spark internals—DAG, stages, tasks, caching, joins, partitioning

• Hands-on experience with performance tuning in production Spark jobs

• Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)

• Proficiency in SQL

• Experience with any major cloud platform: AWS, Azure, or GCP

Good-to-Have

• Worked with Databricks, Snowflake, or Delta Lake

• Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery

• Familiarity with CI/CD pipelines and Git-based workflows

• Comfortable with SQL optimization and schema design in distributed environments

Equal employment opportunity information
KPMG India has a policy of providing equal opportunity for all applicants and employees regardless of their color, caste, religion, age, sex/gender, national origin, citizenship, sexual orientation, gender identity or expression, disability or other legally protected status. KPMG India values diversity and we request you to submit the details below to support us in our endeavor for diversity. Providing the below information is voluntary and refusal to submit such information will not be prejudicial to you.

B.Tech/B.E.

Experience Level

Senior Level