Senior PySpark Developer - Data Engineer

Synechron Technologies

Chennai

Not disclosed

Work from Office

Full Time

Min. 7 years

Job Details

Job Description

Sr. PySpark Developer Data Engineer

Education

  • Degree in computer science, engineering, mathematics, or equivalent experience 

Experiences:

  • 7+ years of previous commercial experience as a leader in a data-driven role
  • 7+ years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
  • 7+ years of experience in ML pipeline for streaming/batch workflow

Knowledge & Skills

  • Ability to write clean, maintainable, and robust code in Python
  • Understanding and expertise of software engineering concepts and best practices
  • Knowledge of testing frameworks and libraries
  • Experience with analytics (descriptive, predictive, EDA), feature engineer, algorithms, anomaly detection, data quality assessment and python visualization libraries - e.g. matplotlib, seaborn or other
  • Comfortable with notebook and source code development - Jupyter, Pycharm/VScode
  • Hands-on experience of technologies like Python, Spark/Pyspark, Hadoop/MapReduce/HIVE, Pandas etc.
  • Familiarity with query languages and database technologies, CI/CD, testing and validation of data and software
  • Tech stack and activities that you would use and preform on a daily basis
    • Python
    • Spark (PySpark)
    • Jupyter
    • SQL and No-SQL DBMS
    • Git (as source code versioning and CI/CD)
    • Exploratory Data Analysis (EDA)
    • Imputation Techniques
    • Data Linking / Cleansing
    • Feature Engineering
    • Apache Airflow/ Jenkins scheduling and automation, Github and Github Actions
  • Collaborative - able to build strong relations that enable robust debate and resolve periodic disagreements regarding priorities.
  • Excellent interpersonal, and communication skills
  • Ability to communicate effectively with technical and non-technical audience
  • Ability to work under pressure with a solid sense for setting priorities
  • Ability to lead technical work with strong sense of ownership
  • Strong command of English language (both verbal and written)

Behavioral Competencies

  • Thinking Related
  • People Related
  • Self-Related
  • Practical and action oriented
  • Compelling communicator
  • Excellent stakeholder management
  • Foster and promote entrepreneurial spirit and curiosity amongst team members
  • Team player
  • Quick learner

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Experience Level

Senior Level

Job role

Work location

Chennai, India

Department

Data Science & Analytics

Role / Category

Data Science & Machine Learning

Employment type

Full Time

Shift

Day Shift

Job requirements

Experience

Min. 7 years

About company

Name

Synechron Technologies

Job posted by Synechron Technologies

Apply on company website