PySpark, Spark Developer
Infosys
Work from Office
Full Time
Min. 5 yearsJob Description
PySpark, Spark Developer
Required Skills Strong experience in PySpark, Apache Spark, and Python. Good understanding of Spark Core, Spark SQL, DataFrames, and RDDs. Experience with Hive, HDFS, SQL, and data warehousing concepts. Knowledge of Azure Databricks, AWS EMR, or Hadoop Ecosystem. Experience with performance tuning and query optimization. Hands-on experience with Git and Agile methodologies. Strong analytical and problem-solving skills. ob Title: PySpark / Spark Developer Experience: 5-8Years Design, develop, and maintain scalable data processing solutions using Apache Spark and PySpark. Build and optimize ETL/ELT pipelines for large-scale data processing. Develop Spark applications for batch and real-time data processing. Analyze, transform, and load structured and unstructured data from multiple sources. Tune Spark jobs for performance, scalability, and reliability. Work with distributed computing frameworks and big data technologies. Collaborate with Data Engineers, Data Architects, and Business Analysts to understand requirements. Troubleshoot production issues and provide efficient solutions. Implement data quality checks and monitoring mechanisms. Follow coding standards, version control, and CI/CD best practices.Job role
Job requirements
About company
Similar jobs you can apply for
Software / Web DeveloperITAD CO ORDINATOR
Provident Hr SolutionsWork from OfficeFull TimeMin. 5 years
Good (Intermediate / Advanced) EnglishQuality Control Engineer
M/S S K Manpower SolutionsWork from OfficeFull TimeMin. 1 yearBasic English
Junior Analyst
Real Capital VenturesWork from OfficeFull TimeAny experienceGood (Intermediate / Advanced) EnglishQuality Assurance
SwiggyWork from OfficeFull TimeMin. 1 yearGood (Intermediate / Advanced) EnglishQuality Control Engineer
Teamlease Services LimitedWork from OfficeFull TimeMin. 3 yearsBasic English
Software Engineer
AskmeOffers.comWork from OfficeFull TimeAny experienceBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 8 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!