Data Engineer

Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : AWS BigData
Good to have skills : NA
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Custom Software Engineer, you will engage in the development of custom software solutions that are designed to meet specific business needs. Your typical day will involve coding, enhancing components, and collaborating with various teams to ensure the delivery of scalable and high-performing solutions. You will utilize modern frameworks and agile practices to create effective software applications that align with organizational goals and user requirements. Your role will also require you to stay updated with industry trends and best practices to continuously improve the software development process.

Roles & Responsibilities:
Strong have strong experience in Data Engineering, ETL process, Data quality process
-Should have hands on experience in Python/Pyspark and SQL
-Should have hands on experience in AWS services EMR, EC2, S3, Glue etc. for ETL process
- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Facilitate knowledge sharing sessions to enhance team capabilities.
- Mentor junior team members to foster their professional growth.
- Shift time will be 1 Pm to 10:30 PM
- Candidate should have good communication skills.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in AWS BigData.
- Experience with cloud computing platforms and services.
- Strong understanding of data processing frameworks such as Apache Hadoop and Apache Spark.
- Familiarity with data storage solutions including Amazon S3 and Amazon Redshift.
- Ability to implement data pipelines and ETL processes.

Additional Information:
- The candidate should have minimum 6 years of experience in AWS BigData.
- This position is based at our Mumbai office.
- A 15 years full time education is required.