Lead Data Engineer and Architect - Archival Solutions

Solution Archive Architect

At EY, we’re all in to shape your future with confidence. 

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. 

Join EY and help to build a better working world. 

 

Designation - Archiving Squad Data Engineer Lead-Architect

Job Description          

The Archiving Squad Data lead / architect leads the design and delivery of enterprise archival data workflows, covering data extraction, transformation, and long term retention activities for application retirement programs. The role manages ongoing archival operations on Solix while driving modernization and migration of archived datasets to newer platforms such as Cohesity and cloud object stores (AWS S3, Azure Blob).

This position ensures archival datasets remain accurate, validated, and compliant, while enabling scalable ingestion pipelines, efficient data retrieval, and smooth transition to future-ready archival environments.

 

Key responsibilities include:

• Lead end to end archival data engineering workflows, including extraction, transformation, validation, and ingestion.
• Oversee and optimize Solix platform operations for archival processing and dataset retrieval.
• Architect and manage data migration from Solix to modern archival repositories (Cohesity, AWS S3, cloud storage).
• Develop scalable SQL, ETL/ELT pipelines, and reconciliation frameworks for large legacy datasets.
• Maintain data accuracy, lineage, audit readiness, and retention compliance across archival systems.
• Collaborate with engineers, architects, QA, and workflow teams (e.g., Appian) to ensure reliable archival and retrieval processes.
• Produce clear technical documentation and provide technical leadership to junior engineers.

 

Desired Profile            

The ideal candidate brings deep data engineering expertise, strong experience with archival platforms, and proven leadership in large scale data migration and archival modernization programs.

• The ideal candidate brings deep data engineering expertise, strong experience with archival platforms, and proven leadership in large scale data migration and archival modernization programs.
• Strong hands on experience with Solix Common Data Platform or equivalent archival systems.
• Expert level proficiency in SQL, relational data modeling, and enterprise data transformation.
• Extensive experience developing and optimizing ETL/ELT processes for large datasets.
• Experience migrating archived or historical datasets to modern storage repositories (e.g., Cohesity, AWS S3, Azure Blob).
• Strong understanding of structured and unstructured data processing across enterprise storage systems.
• Familiarity with secondary storage, archival, or long term retention technologies.
• Knowledge of cloud-based storage and data engineering environments, primarily AWS.
• Strong analytical, troubleshooting, communication, and technical leadership skills.
• Ability to collaborate effectively with cross-functional engineering and business teams.
• Experience in regulated industries (Life Sciences, Pharma, BFSI) is preferred.

 

Experience     

• 9–12 years of experience in data engineering, data migration, archival engineering, or enterprise data platform development.
• Extensive hands on experience with relational databases (Oracle, SQL Server, PostgreSQL, MySQL).
• Proven track record in large-scale data extraction, transformation, validation, and archival processing.
• Experience working with archival platforms such as Solix, Cohesity, Commvault, IBM Optim, or similar technologies.
• Experience with cloud storage platforms such as AWS S3 or Azure Blob Storage.
• Experience with application retirement, legacy system decommissioning, and enterprise archival programs is highly desirable.

 

Education       

• B.Tech. / BS in Computer Science; M.Tech / MS in Computer Science

 

Technical Certifications        

Technical Certifications (Preferred)

• Solix CDP Certification (Application Retirement / Archival)
• AWS Data Engineer or AWS Cloud Practitioner Certification
• Microsoft Azure Data Engineer Certification
• Certified SQL Developer / Database Administrator
• Cohesity DataProtect or equivalent cloud archival certification
• Cloud Fundamentals Certifications (AWS / Azure / GCP)

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Experience Level

Senior Level