Senior Data Migration and ETL Developer

Consultant

Role Overview:

We are seeking a highly skilled Senior Developer specializing in Data Migration and ETL to lead complex data integration initiatives across enterprise platforms. The ideal candidate will have extensive experience in SAP S/4HANA, Azure Databricks, and Azure Data Factory (ADF), ensuring seamless migration, transformation, and orchestration of large-scale datasets in a secure and efficient manner.

 

Key Responsibilities:

• Design & Develop ETL Pipelines:
  Build and optimize end-to-end ETL workflows for migrating data from SAP S/4HANA and other source systems into target platforms using ADF and Databricks.
• Data Migration Strategy:
  Implement robust migration frameworks, including staging, transformation, and reconciliation processes, ensuring data integrity and compliance with business rules.
• Integration with SAP Ecosystem:
  Utilize SAP Data Provisioning Agent and connectors for extracting data from ECC/S4HANA, BW, and Datasphere, integrating with Databricks Lakehouse for advanced analytics.
• Performance Optimization:
  Tune Spark jobs, cluster configurations, and ADF pipelines for high throughput and cost efficiency.
• Governance & Security:
  Apply best practices for data governance, metadata management, and secure data handling across environments (Dev, QA, Prod).
• Collaboration:
  Work closely with architects, data engineers, and business stakeholders to align migration activities with enterprise data strategy.

 

Required Skills & Experience:

• Technical Expertise:
  • SAP S/4HANA data extraction and integration patterns with expertise on using Data Migration cockpit, Data services.
  • Azure Data Factory (ADF) orchestration and pipeline development.
  • Azure Databricks (PySpark, Delta Lake, Unity Catalog).
  • Strong SQL and Python skills for data transformation.
• Data Architecture Knowledge:
  • Experience with ADLS Gen2, hierarchical namespaces, and Delta Lake format.
  • Familiarity with Common Data Model (CDM) and enterprise data platforms.
• ETL & Migration Frameworks:
  • Hands-on experience with staging, mapping, reconciliation dashboards, and metadata-driven transformations.
• Cloud & Big Data Ecosystem:
  • Understanding of Azure Integration Services and hyperscaler tools (ADF, AWS Glue, etc.).
• Soft Skills:
  • Strong problem-solving, analytical thinking, and stakeholder communication.
  • Ability to lead migration projects and mentor junior developers.

 

Preferred Qualifications:

• 5+ years of experience in data engineering and migration projects.
• SAP certification or proven experience in SAP data integration.
• Experience in Agile delivery and CI/CD practices.

 

Role Overview:

We are seeking a highly skilled Senior Developer specializing in Data Migration and ETL to lead complex data integration initiatives across enterprise platforms. The ideal candidate will have extensive experience in SAP S/4HANA, Azure Databricks, and Azure Data Factory (ADF), ensuring seamless migration, transformation, and orchestration of large-scale datasets in a secure and efficient manner.

 

Key Responsibilities:

• Design & Develop ETL Pipelines:
  Build and optimize end-to-end ETL workflows for migrating data from SAP S/4HANA and other source systems into target platforms using ADF and Databricks.
• Data Migration Strategy:
  Implement robust migration frameworks, including staging, transformation, and reconciliation processes, ensuring data integrity and compliance with business rules.
• Integration with SAP Ecosystem:
  Utilize SAP Data Provisioning Agent and connectors for extracting data from ECC/S4HANA, BW, and Datasphere, integrating with Databricks Lakehouse for advanced analytics.
• Performance Optimization:
  Tune Spark jobs, cluster configurations, and ADF pipelines for high throughput and cost efficiency.
• Governance & Security:
  Apply best practices for data governance, metadata management, and secure data handling across environments (Dev, QA, Prod).
• Collaboration:
  Work closely with architects, data engineers, and business stakeholders to align migration activities with enterprise data strategy.

 

Required Skills & Experience:

• Technical Expertise:
  • SAP S/4HANA data extraction and integration patterns with expertise on using Data Migration cockpit, Data services.
  • Azure Data Factory (ADF) orchestration and pipeline development.
  • Azure Databricks (PySpark, Delta Lake, Unity Catalog).
  • Strong SQL and Python skills for data transformation.
• Data Architecture Knowledge:
  • Experience with ADLS Gen2, hierarchical namespaces, and Delta Lake format.
  • Familiarity with Common Data Model (CDM) and enterprise data platforms.
• ETL & Migration Frameworks:
  • Hands-on experience with staging, mapping, reconciliation dashboards, and metadata-driven transformations.
• Cloud & Big Data Ecosystem:
  • Understanding of Azure Integration Services and hyperscaler tools (ADF, AWS Glue, etc.).
• Soft Skills:
  • Strong problem-solving, analytical thinking, and stakeholder communication.
  • Ability to lead migration projects and mentor junior developers.

 

Preferred Qualifications:

• 5+ years of experience in data engineering and migration projects.
• SAP certification or proven experience in SAP data integration.
• Experience in Agile delivery and CI/CD practices.

 

Role Overview:

We are seeking a highly skilled Senior Developer specializing in Data Migration and ETL to lead complex data integration initiatives across enterprise platforms. The ideal candidate will have extensive experience in SAP S/4HANA, Azure Databricks, and Azure Data Factory (ADF), ensuring seamless migration, transformation, and orchestration of large-scale datasets in a secure and efficient manner.

 

Key Responsibilities:

• Design & Develop ETL Pipelines:
  Build and optimize end-to-end ETL workflows for migrating data from SAP S/4HANA and other source systems into target platforms using ADF and Databricks.
• Data Migration Strategy:
  Implement robust migration frameworks, including staging, transformation, and reconciliation processes, ensuring data integrity and compliance with business rules.
• Integration with SAP Ecosystem:
  Utilize SAP Data Provisioning Agent and connectors for extracting data from ECC/S4HANA, BW, and Datasphere, integrating with Databricks Lakehouse for advanced analytics.
• Performance Optimization:
  Tune Spark jobs, cluster configurations, and ADF pipelines for high throughput and cost efficiency.
• Governance & Security:
  Apply best practices for data governance, metadata management, and secure data handling across environments (Dev, QA, Prod).
• Collaboration:
  Work closely with architects, data engineers, and business stakeholders to align migration activities with enterprise data strategy.

 

Required Skills & Experience:

• Technical Expertise:
  • SAP S/4HANA data extraction and integration patterns with expertise on using Data Migration cockpit, Data services.
  • Azure Data Factory (ADF) orchestration and pipeline development.
  • Azure Databricks (PySpark, Delta Lake, Unity Catalog).
  • Strong SQL and Python skills for data transformation.
• Data Architecture Knowledge:
  • Experience with ADLS Gen2, hierarchical namespaces, and Delta Lake format.
  • Familiarity with Common Data Model (CDM) and enterprise data platforms.
• ETL & Migration Frameworks:
  • Hands-on experience with staging, mapping, reconciliation dashboards, and metadata-driven transformations.
• Cloud & Big Data Ecosystem:
  • Understanding of Azure Integration Services and hyperscaler tools (ADF, AWS Glue, etc.).
• Soft Skills:
  • Strong problem-solving, analytical thinking, and stakeholder communication.
  • Ability to lead migration projects and mentor junior developers.

 

Preferred Qualifications:

• 5+ years of experience in data engineering and migration projects.
• SAP certification or proven experience in SAP data integration.
• Experience in Agile delivery and CI/CD practices.

Experience Level

Senior Level