AWS Data Engineer

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.

Technology: AWS (EMR, Redshift, S3, Glue, Kinesis and Lambda), SQL, ETL, Python/Java

Description

• Work with Amazon's personnel and analysts to understand requirements and design solutions based on information provided by Amazon.
• Build highly available distributed systems of data extraction, ingestion, and processing of large data sets using native Amazon and AWS technologies like EMR, Redshift, S3, Glue, Kinesis and Lambda.
• Write SQL and data warehousing queries. Work with developers, TPM and PM on the overall end to end design and provide solutions in line with the design.
• Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
• Interface with other technology teams of Amazon to extract, transform, and load data from a wide variety of data sources using SQL and AWS big data technologies.
• Build highly scalable, re-usable programs/scripts using Unix shell, Python, Ruby, Java etc. which solves data problems.
• Develop integrations on ETL tools like Informatica, AWS Big Data technologies or any other 3rd party tool.
• Update relevant documentation consisting of designs, technical specifications, and production support documentation.
• Collaborate with Amazon's personnel and analysts and technical architects during the term of engagement.
• Work with Amazon quality assurance / testing resources of Amazon to develop test scripts and support testing needs.
• Assist in resolving defects identified during testing by either Party; or
• Provide on-going status updates and highlight risks for the deliverables to Amazon.

Mandatory skill sets- AWS (EMR, Redshift, S3, Glue, Kinesis and Lambda), SQL, ETL, Python/Java   

Preferred skill sets- Python/Java - Either of the one programming languages experience   

Year of experience required- 4 to 8 years   

Qualifications- Graduate Engineer or Management Graduate