Data Engineer

Data Engineer

Project Role : Data Engineer
Project Role Description : --Resource should have 5+ years of work exp. Strong data warhouse knowledge + Data Analytics in Banking Domain, along with hands on SQL+Python Skills + DQ - Develop, optimize, and maintain complex SQL queries - Good understanding on data, users and should be able to write python code to generate reports. - Build automated data pipelines using Python (Pandas, NumPy, SQLAlchemy, PySpark, etc.). - Integrate data from multiple sources (APIs, flat files, cloud storage, third-party systems). -Experience in Handling DWH & Cl
Must have skills : Python Frameworks
Good to have skills : Ab Initio
Minimum 2 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Data Engineer, a typical day involves managing and enhancing data infrastructure to support business analytics and reporting needs. The role includes designing and maintaining data pipelines that efficiently collect, process, and integrate data from diverse sources. Collaboration with various teams to understand data requirements and ensure data quality is a key part of daily activities. The position demands continuous monitoring and troubleshooting of data workflows to maintain seamless data availability and reliability, enabling informed decision-making across the organization.

Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to gather and analyze data requirements.
- Ensure data pipelines are scalable, reliable, and maintainable to support evolving business needs.
- Assist junior team members by sharing knowledge and providing guidance on best practices.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in Python Frameworks, Ab Initio.
- Good To Have Skills: Experience with Ab Initio.
- Strong expertise in building and optimizing data pipelines using Python libraries such as Pandas and NumPy.
- Experience with integrating data from multiple sources including APIs, flat files, and cloud storage.
- Familiarity with data warehousing concepts and handling large-scale data environments.
- Ability to write complex SQL queries and optimize them for performance.

Additional Information:
- The candidate should have minimum 2 years of experience in Python Frameworks.
- This position is based at our BBDC1A - NON-STPI location.
- A 15 years full time education is required.