Technical Lead - Data Engineering
Birlasoft LimitedPune
Not disclosed
Job Description
Technical Lead-Data Engg
Area(s) of responsibility
Job Description: Azure Data Engineer
Key Responsibilities
1. Data Solution Design & Architecture
- Design end‑to‑end data engineering solutions using Azure Data Factory, Azure Databricks, PySpark, SQL, and other Azure-native services.
- Architect and implement scalable and secure Modern Data Warehouse (MDW) and Lakehouse solutions leveraging Azure Data Lake Storage and Databricks.
2. Databricks & PySpark Engineering
- Develop scalable transformation scripts using PySpark on Databricks, applying advanced optimizations like caching, partitioning, and Delta Lake capabilities.
- Implement Delta Lake features—ACID transactions, schema enforcement, schema evolution, and time travel—across the data lifecycle.
- Perform performance tuning, handling bottlenecks related to cluster configuration, shuffle operations, joins, and parallelization.
- Collaborate with platform teams to manage Databricks clusters, jobs, notebooks, and CI/CD integrations.
Experience Level
Senior LevelJob role
Work locationINDIA - PUNE - BIRLASOFT OFFICE - HINJAWADI, IN
DepartmentData Science & Analytics
Role / CategoryData Science & Machine Learning
Employment typeFull Time
ShiftDay Shift
Job requirements
ExperienceMin. 5 years
About company
NameBirlasoft Limited
Job posted by Birlasoft Limited
Similar jobs you can apply for
Accounts / Finance
Android Developer Trainee
IBG Infotech Private LimitedHadapsar, Pune
₹10,000 - ₹15,000
Quality Engineer
Technovision EnergyNarhe, Pune
₹15,000 - ₹25,000
Quality Engineer
Recruit BoxPune
₹40,000 - ₹80,000
Full-stack Developer
THE NaukriWalaPune
₹50,000 - ₹1,20,000
Salesforce Developer
THE NaukriWalaPune
₹60,000 - ₹1,49,000
Website Developer
SDMNC Software Private LimitedKharadi, Pune
₹10,000 - ₹30,000