Databricks ETL Lead Engineer

ETL Databricks Lead

Job Summary:
We are seeking a seasoned Databricks Integration Manager to lead the design, implementation, and optimization of Databricks-based data solutions. The ideal candidate will have deep expertise in cloud platforms (especially AWS or Azure), data engineering, and integration strategies, with a strong background in managing cross-functional teams and delivering scalable data platforms.

Key Responsibilities

• Lead end-to-end integration of Databricks with enterprise data platforms and cloud services.
• Collaborate with data architects, engineers, and business stakeholders to define integration strategies.
• Design and implement scalable data pipelines using Databricks, Spark, and cloud-native tools.
• Manage role-based access controls, Unity Catalog, and secure data environments.
• Ensure compliance with data governance, security, and performance standards.
• Provide technical leadership and mentorship to junior engineers and analysts.
• Coordinate with vendors and internal teams for smooth deployment and support.

Required Skills & Qualifications

• 8–13 years of experience in data engineering, cloud integration, or DevOps roles.
• Strong hands-on experience with Databricks, Spark, Python, and YAML.
• Deep understanding of AWS/Azure cloud architecture, Unity Catalog, and network security.
• Experience with CI/CD tools and infrastructure as code.
• Proven ability to manage complex projects and cross-functional teams.
• Excellent communication and stakeholder management skills.

Preferred Qualifications

• Databricks certification (e.g., Data Engineer Associate/Professional).
• Experience with other data platforms like Snowflake.
• Experience with Reltio MDM platform.
• Healthcare domain knowledge
• Familiarity with Agile methodologies and project management tools.

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide. Learn more at https://jobs.iqvia.com

IQVIA is committed to integrity in our hiring process and maintains a zero tolerance policy for candidate fraud. All information and credentials submitted in your application must be truthful and complete. Any false statements, misrepresentations, or material omissions during the recruitment process will result in immediate disqualification of your application, or termination of employment if discovered later, in accordance with applicable law. We appreciate your honesty and professionalism.

Experience Level

Senior Level