Principal Data Engineer

Databricks - Principal Data Engineer

Core Responsibilities:
•    Databricks Architecture — Design, optimize, and manage end‑to‑end data pipelines using Databricks (Spark, Delta Lake, Unity Catalog).
•    ETL/ELT Pipelines — Build scalable ingestion and transformation frameworks for structured and semi‑structured data.
•    Cloud Platforms — Implement solutions on Azure/AWS/GCP with strong understanding of compute, storage, and networking.
•    Data Warehouse Modernization — Lead migration from legacy systems to modern lakehouse architectures.
•    Team Leadership — Mentor engineers, conduct design reviews, and drive delivery excellence.
•    Customer Engagement — Lead technical discussions, requirement workshops, and solution walkthroughs.
Required Skills & Qualifications”
•    Databricks Expertise: Deep knowledge of Unity Catalog, Photon engine, Databricks SQL, and optimization.
•    Cloud Infrastructure: Proven experience architecting scalable data solutions on Azure, AWS, or GCP.
•    Data Warehousing: Advanced mastery of ETL/ELT pipeline design, data modeling, and performance tuning.
•    Soft Skills: Exceptional analytical thinking, stakeholder management, and clear technical articulation.
•    Strong command of Spark, Delta Lake, Python/Scala, SQL, CI/CD, DevOps.
•    Experience with large‑scale DWH, performance tuning, and data modeling.
•    Proven ability to lead multi‑team delivery in enterprise environments.

•    Total Experience: 12 years
•    Relevant Experience: 7 years in Databricks and cloud data engineering
•    Location: Hybrid
•    Employment Type: Full-time

Experience Level

Senior Level