Data Engineer

Data Engineer 1

Responsibilities

• Implement Data engineering solutions on premise or on cloud for IIOT Ecosystem. (Sensor Data)
• Leverage open source ETL tools
• Develop batch processing, streaming and integration solutions
• Monitor databases and data processing for a specified scenario
• Implement big data real-time processing and integration solutions
• Leverage Azure Cloud services

Basic Qualifications

 

• Education: B.E./M.Sc./M.E./M. Tech. 
• Experience: 3 – 5 years in Core Data Engineering. 
• Minimum 1 Year in Azure Data Engineering

 

Knowledge & Skills

• Very strong @ SQL-PL SQL   - MS Sql Server , PostGre SQL
• Experience in Pyspark and Microsoft Fabric or Databricks 
• Files Processing – XML, CSV, Excel, JSON, etc. Formats
• Structured and Non-Structured Data processing
• Data ETL Capabilities using tools like Talend, Node -Red etc.
• Experience with REST APIs, Web Services 
• Experience with Event Hub, IoT Hub, Azure Functions, etc. on Azure.

Required Competencies 

• Nimble learning. Willingness to explore and adapt
• Good verbal & written English communication
• Ability to work with globally diverse teams. 
• Abstract & Analytical Thinking.
• Interpersonal savvy. A very good team player

Experience Level

Mid Level