Data Engineer

Data Engineer

Job Description

Your Responsibilities:
The Data Engineer role will work on designing, building, and implementing data solutions to support strategic analytics projects & initiatives that drive strategic growth for ADM. This involves liaising with functional teams that generate or acquire data, with application owners to understand raw or source data structures, and end users to accurately design and build strategically significant Data centric projects.

• Standardize data and reporting across businesses and teams to enhance the consistency and quality of data
• Design, develop, test and document data integrations and assist with deployment, validation and hyper care processes
• Maintain and support existing ETL/ELT integrations leveraging technical documentation
• Develop and maintain existing codebases as needed
• Assist with review to confirm technical feasibility of integration development objects based on integration principles and best practices
• Understand and navigate a wide array of source data systems (enterprise data warehouses, relational databases, IT systems, in house and COTS applications, documents, APIs, unstructured data, big data, NoSQL databases, etc.)
• Analyze data and assist with developing insights to enable business decision making
• Developing prototypes and proof of concepts for required solutions
• Contribute to high level solution/project design
• Document solutions through high/low level design documentation
• Synthesize & communicate ideas and recommendations to colleagues and management
• Recommend solutions to address gaps in current data processes
• Assist with project development estimation (epics, stories, features, bugs)
• Supervise and review activities of external project partners

Your Profile:

• Bachelor’s Degree in Business Analytics, Statistics, Computer Science or related field
• 2-5 years of experience performing data mining, data analytics and predictive modeling initiatives
• Significant SQL Scripting / TSQL development experience
• Significant Experience in at least one other programming language (Python, Java, Scala)
• Proven data processing (ETL/ELT), data mining, data analytics and predictive modeling abilities
• OLAP & OLTP database development experience with relational databases like MSSQL Server/Oracle & Postgres
• Understanding of data warehousing and data mart concepts
• Azure Cloud experience (Administration, Data engineering & Networking)
• Experience with pipelining tools (ADF/Azure Synapse/Databricks Pipelines preferred)
• Experience with MPP systems, Azure Synapse/Databricks preferred
• Familiarity with supervised and unsupervised machine learning techniques
• Experience of working within an Agile development framework
• Unit & Integration testing experience (concepts such as TDD) and experience of frameworks (such as SSDT, Pytest)
• DevOps implementation/execution experience (source control, CI/CD, release environment management)
• Ability to develop and solution both independently and collaboratively a necessity

Preferred additional experience:

• Salesforce Integration experience (e.g. adf salesforce bulk api)
• PowerShell Core development.
• Understanding of GenAI fundamentals (i.e. Retrieval Augmented Generation, embeddings, direct and indirect search methods).

City

Bengaluru

State

Karnataka

Location Country

India

About ADM

At ADM, we unlock the power of nature to provide access to nutrition worldwide. With industry-advancing innovations, a complete portfolio of ingredients and solutions to meet any taste, and a commitment to sustainability, we give customers an edge in solving the nutritional challenges of today and tomorrow. We’re a global leader in human and animal nutrition and the world’s premier agricultural origination and processing company. Our breadth, depth, insights, facilities and logistical expertise give us unparalleled capabilities to meet needs for food, beverages, health and wellness, and more. From the seed of the idea to the outcome of the solution, we enrich the quality of life the world over. Learn more at www.adm.com.

Experience Level

Mid Level