Pyspark Developer

Pyspark Developer

Primary Skills : Pyspark, Spark and proficient in SQL Secondary Skills : Scala and Python Experience : 3 + Yrs • Advanced conceptual understanding of at least one Programming Language • Advanced conceptual understanding of one database and one Operating System • Understanding of Software Engineering with practice in at least one project • Ability to contribute in medium to complex tasks independently • Exposure to Design Principles and ability to understand Design Specifications independently • Ability to run Test Cases and scenarios as per the plan • Ability to accept and respond to production issues and coordinate with stake holders • Good understanding of SDLC • Analytical abilities • Logical thinking • Awareness of latest technologies and trends Bachelor’s degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education At least 5 years of experience in Pyspark, Spark with Hadoop distributed frameworks while handling large amount of big data using Spark and Hadoop Ecosystems in Data Pipeline creation , deployment , Maintenance and debugging Experience in scheduling and monitoring Jobs and creating tools for automation At least 4 years of experience with Scala and Python required. Proficient knowledge of SQL with any RDBMS. Strong communication skills (verbal and written) with ability to communicate across teams, internal and external at all levels. Ability to work within deadlines and effectively prioritize and execute on tasks.   Preferred Qualifications: At least 1 years of AWS development experience is preferred Experience in Drive automations DevOps Knowledge is an added advantage.