PySpark Developer
InfosysJob Description
PySpark Developer
Technology->Big Data - Data Processing->PySpark Key Responsibilities Develop and maintain data pipelines using PySpark Process and analyze large-scale datasets in distributed environments Design and implement ETL/ELT workflows Optimize Spark jobs for performance and scalability Work with data stored in HDFS, Hive, or cloud storage (S3, ADLS) Collaborate with data engineers, analysts, and business teams Ensure data quality, integrity, and governance Debug and troubleshoot data processing issues Automate workflows using scheduling tools (Airflow, Oozie, etc.) Write clean, scalable, and efficient code Required Skills & Qualifications Technical Skills Strong proficiency in Python and PySpark Good experience with Apache Spark (RDDs, DataFrames, Spark SQL) Knowledge of Hadoop ecosystem (HDFS, Hive) Experience in ETL pipeline development Familiarity with SQL and database concepts Experience with data formats (Parquet, ORC, JSON, CSV) Basic understanding of distributed computing concepts Exposure to version control tools (Git)Job role
Job requirements
About company
Similar jobs you can apply for
Software / Web DeveloperSoftware Developer
SHLR Technosoft
Data Analytics Trainer (Student-Facing)
Kadtech HR SolutionsProduct Executive
Tatvam Ai Labs Private Limited
Quality Control Executive
Flavour TroveQuality Control Engineer
M/S Progressive Systems
Mern Stack Developer
Crobstacle Ventures LLPYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 2 to 5 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!