JD:

 10+ years relevant data engineering hands on work experience- data ingestion, processing, exploratory analysis to build solutions that deliver value through data as an asset.

•             Data engineer build ,test and deploy data pipelines efficiently and reliably move data across systems and should be top of latest architectural trends on AZURE cloud.

•             Folks who understand parallel and distributed processing, storage, concurrency, fault tolerant systems.

•             Folks who thrive on new technologies, able to adapt and learn easily to meet the needs of next generation engineering challenges.

Technical Skills (Must-Have)

•             Applied experience with distributed data processing frameworks - Spark , Databricks with Python and SQL

•             Must have worked at least 2 end-end data analytics projects with Databricks Configuration , Unity Catalog, Delta Sharing and medallion architecture.

•             Applied experience with Azure Data services ADLS , Delta Lake , Delta Live Tables , Azure Storage, RBAC

•             Applied experience with Unit Testing and System Integration Testing using Python framework.

•             Applied experience with Devops to design and deploy CI/CD pipelines using Jenkins.

•             AZURE Data Engineering(DP203) or DATABRICKS certification

•            Prior working experience with high performance agile team - Scrum , JIRA ,JFrog and Confluence