Senior Data Platform Engineer

Data Platform Engineer

Project Role : Data Platform Engineer
Project Role Description : Assists with the data platform blueprint and design, encompassing the relevant data platform components. Collaborates with the Integration Architects and Data Architects to ensure cohesive integration between systems and data models.
Must have skills : Databricks Unified Data Analytics Platform
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Senior Data Engineer/Backend Developer with deep knowledge on Databricks or MS Fabric, you will design, develop, and maintain scalable data pipelines and systems using Databricks/Fabric. You will also be involved in defining the data requirements and structure for the applications. Your typical day will involve optimizing and tuning of data processing workflows for better performance. You will also be responsible to ensure data quality, integrity and security across applications. You should possess very good communication skills to liaise with the client stakeholders and other experts like Data scientists, architects and modelers to translate business requirements into effective data solutions, while also addressing any challenges that arise during the development process. Your role will be pivotal in establishing robust quality in data that matches the organization's data strategy and enhances data accessibility and usability across teams.

Roles & Responsibilities:
- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams like data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions to contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Facilitate knowledge sharing sessions to enhance team capabilities and foster a culture of continuous improvement.
- Develop and maintain documentation related to data architecture, ensuring clarity and accessibility for all stakeholders.

Professional & Technical Skills:
- Must Have Skills: Proficiency in Databricks or MS Fabric with strong troubleshooting skills.
- Strong understanding of data modeling techniques and best practices.
- Experience with data pipelines, ETL processes and data integration tools.
- Proficiency in Apache Spark and in programming languages such as Python.
- Familiarity with cloud data platforms and services.
- Ability to design and implement data governance frameworks.
- Hands-on ability to handle large volumes of data in day-to-day tasks.

Additional Information:
- The candidate should have minimum 7.5 years of experience in Databricks or MS Fabric.
- A 15-year full time education is required.