Senior Data Engineer

Senior Data Engineer

Location Mandatory: Bengaluru

Data Engineer I role definition

Description

The Junior Data Engineer is responsible for supporting development and delivery of end to end data solutions. The incumbent supports solution envisaging and technical designs and drives handson implementation Supports the influencing differentiation and guidance to business and technology strategies as they relate to data through constant cross-functional interaction

Key responsibilities

• Drive efficiency and resilience by mapping data flows between systems and workflows across the company
• Ensure standardization by following design patterns in line with global and local data governance requirements
• Support realtime internal and customerfacing actions by developing realtime eventbased streaming data pipelines
• Enable rapid datadriven business decisions by supporting development of efficient and scalable data ingestion solutions
• Drive highvalue data by connecting different disparate datasets from different systems
• Monitor and follow relevant SLIs and SLOs
• Handle mitigate and learn from incidents in a manner that improves the overall system health
• Ensure ongoing resilience of data processes by monitoring system performance and acting proactively identifying bottlenecks potential risks and failure points that might degrade overall quality
• Write readable and reusable code by applying standard patterns and using standard libraries
• Continuously evolve own craft by keeping up to date with the latest developments in data engineering and related technologies and upskilling on these as needed
• Responsible for technical implementation and maintenance of data processing services and storage systems in line with the Data Governance Framework

Communication

• Stakeholders DE Manager PM Data Engineers
• Type Information Cooperation
• Frequency Frequent Continuous

Level of education

Bachelors degree in Computer Science or related field

Masters degree in Computer Science or related field

Years of relevant job knowledge

• Basic Job Knowledge 1-3 years
• Requirements of special knowledge and skills
• Entry level exposure to a data engineering or related field using a serverside programming language preferably Scala Java Python or Perl
• Entry level exposure to building data pipelines and transformations at scale with technologies such as Hadoop Cassandra Kafka Spark HBase MySQL
• Basic knowledge of data modeling methods based on best practices eg TOGAF
• Basic knowledge of data quality requirements and implementation methodologies
• Excellent English communication skills both written and verbal