Lead Data Engineering Analyst

Lead Analyst, Data Engineering

Work Flexibility: Hybrid

Tech Lead – Decommissioning Services

The Tech Lead will own the technical and functional governance of the Solix-based data archival platform, while also bringing deep expertise in the Azure Data ecosystem. You will lead a managed services team, collaborate with cross-functional stakeholders, and ensure decommissioning projects are executed with rigor, quality, and compliance.

What you will do:

Technical Leadership & Platform Governance

• Provide technical governance over the Solix data archival platform, ensuring consistent processes across project and run teams
• Lead and participate in assessment, planning, testing, and data load activities during decommissioning engagements
• Investigate, implement, and maintain advanced system monitoring tools to ensure platform uptime and reliability
• Contribute to future technology roadmaps and the structured retirement of legacy environments
• Review technical reports and assess platform impact across ongoing projects and deliveries

Azure Data Platform & Engineering

• Design and oversee data archival and extraction workflows leveraging the Azure Data Platform (Azure Data Factory, Azure Data Lake)
• Apply expertise in Apache Spark for large-scale data processing and transformation during archival and migration activities
• Leverage understanding of Azure Kubernetes Service (AKS) for containerized workload management within the decommissioning ecosystem
• Write and review complex SQL queries to support data extraction, validation, and ad hoc reporting requirements

Governance, Compliance & Process

• Ensure adherence to data privacy laws and regulatory requirements across all archival activities
• Establish and maintain a robust working model for data archival operations and ad hoc data extraction requests
• Author and review SOW documents and Knowledge Base (KB) articles; ensure their accurate utilization by the team

Team Leadership & Stakeholder Management

• Lead and mentor the Solix managed services operations team
• Manage task planning, prioritization, and resource alignment across project phases
• Act as the escalation point for issues within the local time zone
• Collaborate with architects, technical leads, and development leads to align on upcoming projects, deployments, and hypercare phases
• Evaluate and continuously improve operational processes for efficiency and quality.

What you need:

• Bachelors or Masters Degree in Computer Science or similar technical discipline
• 6 to 10 years of work experience in Azure Data Platform (Azure Data Factory, Azure Data Lake) and Apache Spark
• Experience with large-scale data processing and transformation during archival and migration activities
• Experience in managing and leading technical team members and strong stakeholder management skills

Travel Percentage: 10%

Experience Level

Senior Level