Azure Data Engineer

Digital Finance CoE - Azure Data Engineer - Executive

Roles & responsibilities

Operational:

• •Design, develop, and support data solutions using Azure platform to enhance operational efficiency and data integrity. •Utilize expertise in Python, PySpark, and SQL to analyze complex datasets and generate insightful reports that drive improvements in client operations. •Implement configurations and develop technical solutions that automate processes and ensure seamless integration of data across various cloud platforms. •Functional: • •Build ETL workflows and automate data pipeline tasks using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and AWS Glue. •Develop scripts and automation tools for data ingestion and transformation, leveraging PySpark and other libraries to streamline processes. •Create and manage robust data processing applications, ensuring effective data exchange and integration between systems.

Roles & responsibilities

Operational:

• •Design, develop, and support data solutions using Azure platform to enhance operational efficiency and data integrity. •Utilize expertise in Python, PySpark, and SQL to analyze complex datasets and generate insightful reports that drive improvements in client operations. •Implement configurations and develop technical solutions that automate processes and ensure seamless integration of data across various cloud platforms. •Functional: • •Build ETL workflows and automate data pipeline tasks using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and AWS Glue. •Develop scripts and automation tools for data ingestion and transformation, leveraging PySpark and other libraries to streamline processes. •Create and manage robust data processing applications, ensuring effective data exchange and integration between systems.

Roles & responsibilities

Operational:

• •Design, develop, and support data solutions using Azure platform to enhance operational efficiency and data integrity. •Utilize expertise in Python, PySpark, and SQL to analyze complex datasets and generate insightful reports that drive improvements in client operations. •Implement configurations and develop technical solutions that automate processes and ensure seamless integration of data across various cloud platforms. •Functional: • •Build ETL workflows and automate data pipeline tasks using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and AWS Glue. •Develop scripts and automation tools for data ingestion and transformation, leveraging PySpark and other libraries to streamline processes. •Create and manage robust data processing applications, ensuring effective data exchange and integration between systems.

Experience Level

Executive Level