Lead Data Engineer and ETL Technical Lead

Data Engineer /ETL Lead Sr Technical Lead-Data Engg

Area(s) of responsibility

Job Title - Lead Data Engineer / ETL Lead

Key Responsibilities

• Lead the design, development, and optimization of end-to-end data pipelines across batch and real-time processing
• Architect and implement enterprise-grade ETL solutions using Informatica, Ab Initio, and cloud-native services
• Drive large-scale data migration and conversion initiatives, including mock runs, reconciliation, validation, and production cutovers
• Design and manage cloud-based data platforms, leveraging Snowflake and AWS analytics services
• Build and optimize PySpark-based data processing frameworks for high-volume datasets
• Implement real-time data ingestion and transformation pipelines using Kafka and streaming technologies
• Own performance tuning, scalability, cost optimization, and SLA adherence for data workloads
• Collaborate closely with business, functional, and architecture teams to translate requirements into robust technical solutions
• Lead and mentor development teams, conducting code reviews and enforcing engineering best practices
• Oversee CI/CD, scheduling, monitoring, and operational stability of data pipelines
• Support Agile delivery by participating in planning, backlog grooming, execution, and retrospectives.

 

Experience Level

Senior Level