Big Data Developer

Job specification: We are looking for a Big Data Developer to join our team in Bangalore and Chennai

Job Description

About Neostats Analytics: NeoStats is a new-age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them into world-class, data-driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with bases in India & UK. Comprising of industry veterans, we enable structural transformations in Analytics powered by our expertise, true partnership, and e2e implementation approach

About the Job

We are looking for a Big Data Developer to join our team in Bangalore and Chennai. The ideal candidate should have a 5+ years of experience in the industry with experience in SQL, basic Unix command, Hive, and Hadoop environment. You will be responsible for developing and maintaining data pipelines using ETL processes, working closely with the data science team to implement data analytics pipelines, and analyzing vast amounts of data stores to uncover insights. You will also be responsible for defining data governance policies and supporting data-versioning process

Responsibilities

• Develop and maintain data pipelines using ETL processes
• Take responsibility for Apache Hadoop development and implementation
• Work closely with data science team to implement data analytics pipelines
• Help define data governance policies and support data-versioning processes
• Maintain security and data privacy, working closely with data protection officer
• Analyze vast number of data stores to uncover insights
• Collaborate with cross-functional teams to analyze and visualize data
• Develop and maintain data modeling techniques
• Design, implement, and maintain scalable data infrastructure
• Build and maintain data quality dashboards and reports
• Optimize and tune Hadoop environments

Requirements:

• 5+ years of experience in the industry.
• Banking Experience is mandatory.
• Experience with SQL, basic Unix command, Hive, and Hadoop environment.
• Experience with Python, Spark, and Hive.
• Understanding of Data Warehousing and Data-Modeling techniques.
• Knowledge of industry-wide visualization and analytics tools (ex: Tableau, R).
• Strong data engineering skills with Azure/AWS cloud platform.
• Experience with streaming frameworks such as Kafka.
• Knowledge of Linux, SQL, and any scripting language