Data Engineer

Data Engineer

Responsibilities:

• Lead the architecture, design, and development of data warehousing solutions.

• Provide technical guidance and mentorship to the data engineering team.

• Ensure best practices in data warehousing, ETL / ELT processes, and data integration.

• Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.

• Ensure data accuracy, integrity, and consistency across data sources.

• Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.

• Implement and manage data warehousing solutions using Snowflake.

• Utilize AWS Glue for data integration and ETL / ELT tasks.

• Optimize data storage and retrieval processes to enhance performance.

• Apply AI/ML concepts to extract insights from large datasets.

• Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.

• Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.

• Develop data solutions that address specific needs within these domains.

• Collaborate with stakeholders to gather and analyse business requirements

Requirement:

• Overall, 3 to 5 years’ experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture

• BTech in Computer Science or IT

• Technical expertise with data models, data mining, and segmentation techniques

• Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design

• Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have)

• Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team

• Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools

• Domain expertise in Finance, Accounts, and Manufacturing.

• Exposure to agile software development, and/or development management

• Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines

Experience Level

Senior Level