Data Engineer

Data Engineer

Project Role : Data Engineer
Project Role Description : --Resource should have 5+ years of work exp. Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on SQL+Python Skills + DQ - Develop, optimize, and maintain complex SQL queries - Good understanding on data, users and should be able to write python code to generate reports. - Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.). - Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems). -Experience in Handling DWH & Cl
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, a typical day involves managing and enhancing data infrastructure to support business analytics and reporting needs. The role includes designing and maintaining data pipelines that efficiently integrate information from diverse sources. You will spend time collaborating with team members to understand data requirements and ensure data quality. The position requires continuous monitoring and optimization of data workflows to support timely and accurate data delivery. Additionally, you will engage in troubleshooting and resolving data-related issues to maintain seamless operations within the data environment.

Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to gather and analyze data requirements.
- Ensure data integrity and consistency across various data sources and platforms.
- Assist junior team members by providing guidance and support in their tasks.
- Continuously evaluate and improve existing data processes to enhance efficiency and reliability.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in Python Frameworks, Ab Initio.
- Good To Have Skills: Experience with Ab Initio.
- Strong knowledge of data warehousing concepts and architecture.
- Experience in developing and optimizing complex SQL queries.
- Familiarity with building automated data pipelines using Python libraries such as Pandas, NumPy, SQLAlchemy, and PySpark.
- Ability to integrate data from multiple sources including APIs, flat files, cloud storage, and third-party systems.

Additional Information:
- The candidate should have minimum 3 years of experience in Python Frameworks.
- This position is based at our JPDC3A - NON-STPI location.
- A 15 years full time education is required.