Data Engineer

Data Engineer

Project Role : Data Engineer
Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.
Must have skills : Google BigQuery, Airflow
Good to have skills : Microsoft SQL Server, Python (Programming Language)
Minimum 5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand data requirements and deliver effective solutions that meet business needs, while also troubleshooting any issues that arise in the data flow and processing stages. Your role will be pivotal in enhancing the overall data infrastructure and ensuring that data is accessible and reliable for decision-making purposes.
Project Role :
Analytics and ModelorProject Role Description :
Analyze and model client, market and key performance data. Use analytical tools and techniques to develop business insights and improve decision-making.Must have Skills : Google BigQuery, SSI: NON SSI: Good to Have Skills :SSI: No Technology Specialization NON SSI :
Job Requirements :

Roles & Responsibilities:-
1:Data Proc, Pub,Sub, Data flow, Kalka Streaming, Looker, SQL (No FLEX)
2:Proven track record of delivering data integration, data warehousing soln
3: Strong SQL And Hands-on (No FLEX)
4:Exp with data integration and migration projects3:Proficient in BigQuery SQL language (No FLEX)
5:understanding on cloud native services : bucket storage, GBQ, cloud function, pub sub, composer, and Kubernetes
6:Exp in cloud solutions, mainly data platform services , GCP Certifications5: Exp in Shell Scripting, Python (NO FLEX), Oracle, SQLTechnical Experience :

Professional & Technical Skills: -
1: Expert in Python (NO FLEX). Strong hands-on and strong knowledge in SQL(NO FLEX), Python programming using Pandas, NumPy, deep understanding of various data structure dictionary, array, list, tree etc, experiences in pytest, code coverage skills are preferred
2: Strong hands-on experience with building solutions using cloud native services: bucket storage, Big Query, cloud function, pub sub, composer, and Kubernetes etc. (NO FLEX)
3: Proficiency with tools to automate AZDO CI CD pipelines like Control-M , GitHub, JIRA, confluence , CI CD Pipeline
4: Open mindset, ability to quickly adapt new technologies
5: Performance tuning of BigQuery SQL scripts
6: GCP Certified preferred
7: Working in agile environment

Professional Attributes :
1: Must have good communication skills2: Must have ability to collaborate with different teams and suggest solutions3: Ability to work independently with little supervision or as a team4: Good analytical problem solving skills 5: Good team handling skills

Educational Qualification:
15 years of Full time education

Additional Information :
Candidate should be ready for Shift B and work as individual contributor