AWS Glue Module Lead

Module Lead - AWS Glue Job

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

 

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

 

We are looking forward to hire AWS Glue Professionals in the following areas :

 

Experience

5-8 Years

Job Description

• Technical Skills

  1. AWS Glue Data Quality (AWS Ecosystem)
  • Proven experience in designing, implementing, and operationalizing data pipelines using AWS Glue.
  • Hands-on expertise with AWS Glue Data Quality for defining, executing, and monitoring data quality rules.
  • Strong understanding of Glue Crawlers, Jobs, Workflows, and integration with the AWS data lake ecosystem.
  • Hands-on experience developing AWS Lambda functions for data processing and orchestration
  • Hands-on experience with Amazon Athena for querying data in S3, validating datasets, and supporting analytical and reconciliation use cases.
  • Working proficiency with multiple file formats and data structures, including Parquet and JSON, optimized for performance and cost
  • Experience with API integration for ingesting and processing data from external systems
  • Experience integrating Glue workflows with Apache Airflow for scheduling, dependency management, and end-to-end pipeline orchestration.
  2. PySpark & Distributed Data Processing
  3. Snowflake and Snowpark: Working knowledge of snowflake pipelines and stored procedures
  4. Python and SQL:
  5. Data Quality Frameworks:

  Business Skills

  6. Know DQ framework and approach in the context of financial data.
  7. Good with documentation and creating process maps.
  8. Good communication and relation-building skills.
  9. Tactile with a strategic vision to scale DQ solution.
  10. Go-getter and a problem solver: Strong analytical and troubleshooting skills, with the ability to optimize and enhance existing data solutions.

Certifications

Mandatory

 

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

 

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture

Experience Level

Senior Level