Senior Data Engineer
Indium Software India
Apply on company website
Senior Data Engineer
Indium Software India
Bengaluru/Bangalore
Not disclosed
Work from Office
Full Time
Min. 5 years
Job Details
Job Description
Senior Data Engineer
Job Description: We are looking for a highly skilled Senior Data Engineer to design, build, and optimize large-scale data pipelines and distributed data processing systems. The ideal candidate should have strong hands-on experience across Python, Spark, SQL, and modern data engineering frameworks, along with the ability to work in a fast-paced, collaborative environment. Key Responsibilities: ● Design, develop, and maintain scalable and reliable ETL/ELT data pipelines. ● Work with large datasets using Python, Spark, SQL, and distributed data systems. ● Build and optimize workflows leveraging Hadoop ecosystems and big data frameworks. ● Implement data quality checks, validation frameworks, and performance tuning. ● Integrate data from multiple sources and ensure efficient data flow across systems. ● Collaborate with Product, Analytics, and Engineering teams to understand data needs. ● Work with Airflow (preferred) for workflow orchestration and scheduling. ● Deploy and maintain data solutions on any cloud platform (AWS/GCP/Azure preferred). ● Troubleshoot pipeline issues, perform root-cause analysis, and improve reliability. ● Ensure adherence to data governance, security, and best engineering practices. Required Skills: ● Strong expertise in Python, Spark, SQL ● Experience with Hadoop or other distributed processing systems ● Hands-on experience with any cloud platform (preferred) ● Familiarity with Airflow or similar orchestration tools ● Solid understanding of data warehousing, ETL concepts, and data modeling ● Excellent problem-solving, debugging, and optimization skillsExperience Level
Senior LevelJob role
Work location
Bangalore North, India
Department
Data Science & Analytics
Role / Category
Data Science & Machine Learning
Employment type
Full Time
Shift
Day Shift
Job requirements
Experience
Min. 5 years
About company
Name
Indium Software India
Job posted by Indium Software India
Apply on company website