Lead Data Engineer
NTT DATA Global Delivery Services LtdJob Description
Data Principal Engineer
Data Engineer – Lead
Responsibilities:
- Lead the design and implementation of scalable data pipelines and data processing frameworks in Microsoft Fabric.
- Define data engineering standards, development practices, naming conventions, coding guidelines, and reusable technical patterns.
- Lead implementation of Bronze, Silver, and Gold layers in the Medallion Architecture.
- Oversee ingestion, transformation, orchestration, validation, and publication of data from multiple enterprise, clinical, operational, and cloud-based sources.
- Guide development of Fabric Pipelines, Dataflows Gen2, Notebooks, Lakehouse tables, Warehouse objects, and curated datasets.
- Ensure scalability, performance, reliability, maintainability, security, monitoring, and optimization of data solutions.
- Define standards for data quality, reconciliation, logging, error handling, auditability, and lineage.
- Conduct technical design reviews, code reviews, performance reviews, and deployment readiness reviews.
- Mentor and guide data engineering teams across onshore/offshore locations.
- Collaborate with architects, platform engineers, BI teams, QA teams, AI/ML teams, functional consultants, and stakeholders.
- Support deployment planning, release activities, production support, and operational handover.
Skills:
- Strong hands-on experience with Microsoft Fabric, including Lakehouse, Warehouse, OneLake, Pipelines, Dataflows Gen2, Notebooks, and Power BI integration.
- Expertise in ETL/ELT, data pipelines, distributed data processing, and cloud-scale data engineering.
- Strong SQL, Python, PySpark, and data modeling skills.
- Experience with Lakehouse, Warehouse, and Medallion Architecture.
- Understanding of Delta tables, dimensional modeling, star schema, facts, dimensions, and curated analytical datasets.
- Experience integrating structured, semi-structured, file-based, API-based, enterprise application, and cloud data sources.
- Experience with data quality, reconciliation, logging, monitoring, and error-handling frameworks.
- Experience leading technical teams and coordinating onshore/offshore delivery.
- Experience with Git, CI/CD, Azure DevOps, branching, code reviews, and release management.
- Good to Have: Experience with Azure Data Factory, Synapse, Databricks, ADLS Gen2, Azure SQL, Microsoft Purview, or related Azure services.
- Good to Have: Experience with CRO, clinical research, pharma, healthcare and clinical systems.
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Software / Web DeveloperFull Stack Java Developer
Optalon Hr Consultant Private Limited
Quality Control Engineer
Sre Kateel Industries Private LimitedFull Stack Web Developer
Tatvam Ai Labs Private Limited
Web Developer
Om Sai Building SolutionsQuality Executive
Big Basket
Engineering Trainee
Randstad India Private LimitedYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!