Data Engineer
Capco Technologies Pvt Ltd
Work from Office
Full Time
Min. 5 yearsJob Description
Data Engineer (Databrick + Pyspark)
Job Title: Data Engineer (PySpark / Databricks)
Experience: 5–9 Years Location: Pune (Hybrid – Capco Office)
Job Summary
We are looking for a skilled Data Engineer with strong expertise in PySpark, Databricks, and modern data engineering practices. The ideal candidate will have hands-on experience in building scalable data pipelines, working with large datasets, and leveraging cloud-based data platforms.
Key Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines Work extensively with PySpark and Apache Spark for large-scale data processing Build and manage workflows using Apache Airflow Develop and optimize data solutions on Databricks (Jobs, Delta Lake) Work with cloud-based data lakes (S3 or equivalent) Write efficient and complex SQL queries for data transformation and analysis Run and manage Spark workloads on EMR Serverless or other managed Spark platforms Ensure data quality, reliability, and performance optimization of pipelines Must Have Skills Strong hands-on experience with PySpark and Apache Spark internals Experience with Databricks (Jobs, Delta Lake) Proficiency in Apache Airflow for workflow orchestration Solid experience building ETL/ELT pipelines at scale Strong SQL skills and experience with Data Warehouse (DWH) systems Experience running Spark workloads on EMR Serverless or managed Spark platforms Hands-on experience with cloud data lakes (S3 or equivalent) Good to Have Skills Experience with Delta Lake / Apache Iceberg Exposure to streaming frameworks (Spark Structured Streaming, Kafka) Familiarity with CI/CD pipelines for data engineering workflows Knowledge of data governance, cataloging, and lineage tools
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Software / Web Developer
AI/ML Engineer & Application Developer
Sahil Digital ServicesWork from OfficeFull TimeMin. 1 year
Good (Intermediate / Advanced) English
Business Interns
SK4All BizserveWork from OfficeFull TimeAny experienceGood (Intermediate / Advanced) English
QC Specialist
Team ASK Engineers Private LimitedWork from OfficeFull TimeMin. 1 yearBasic English
Quality Control
Mist Ressonance Engineering Private LimitedWork from OfficeFull TimeMin. 6 monthsBasic English
Quality Engineer
Vijaya Management ServicesWork from OfficeFull TimeMin. 1 yearBasic English
Software Developer
Cosmic Infotech
Field JobFull TimeAny experienceBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 9 years are eligible to apply for this job. You can apply for more jobs in Pune to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Pune at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Pune . Through apna, you can find jobs in 64 cities across India. Join NOW!