Senior Data Engineer

Inviting applications for

Job title : Senior Data Engineer

Experience required : 8- 10 years

Technical:

• Must have strong technical hands-on coding experience in Azure Data Factory. Azure Databricks, Pyspark and Python and advance SQL
• Must have strong understanding on Azure eco-system
• Data Analysis.  Able to participate in business discussions and assist Architect with gathering data requirements.  Good analytical and problem-solving skills to help address data challenges.

 

• Advanced SQL Skills.  Proficiency in writing complex SQL queries for data extraction, transformation, and analysis.  Knowledge of SQL functions, joins, subqueries, and performance tuning.  Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data.

 

• Azure Data Factory.  Experience in creating and managing data pipelines using Azure Data Factory.  Understanding of data integration, transformation, and workflow orchestration in Azure environments.

 

• Azure Databricks.  Knowledge of data engineering workflows and best practices in Databricks.  Able to understand existing templates and patterns for development.

 

• Data M odels. Understanding of Dimensional and relational data models and experience in write efficient code  (in SQL and PySpark) to populate data models.

 

• Python (Desired).  Programming skills in Python, particularly for data manipulation and analysis.

 

• Automation: Experience developing solutions to automate data validations tasks using SQL/Python scripts.
•  

Behavioural: