Python+Spark Scala
Infosys
Work from Office
Full Time
Min. 2 yearsJob Description
Python+Spark Scala
• Primary skills:Technology->Big Data - Data Processing->Spark,Technology->Java->Apache,Technology->Machine Learning->Python Core Skills 2–5 years of experience in Python development Hands-on experience with Apache Spark (PySpark and/or Scala) Strong understanding of data processing and ETL concepts Good knowledge of SQL and relational databases Big Data & Spark Development Develop and maintain data processing pipelines using Apache Spark (PySpark & Scala) Work with Spark DataFrames, RDDs, and Spark SQL Implement transformations, joins, aggregations, and optimizations Tune Spark jobs for performance, scalability, and reliability Python & Scala Programming Write clean, efficient, and scalable code in Python and Scala Develop modular and reusable components Integrate data pipelines with various applications and APIs ETL & Data Engineering Design and build ETL workflows for structured and unstructured data Extract data from multiple sources (databases, APIs, flat files) Perform data cleansing, transformation, and validation Ensure data accuracy, consistency, and completeness Data Platforms & Integration Work with Hadoop ecosystem (HDFS, Hive, Spark) Handle large datasets in data lakes and warehouses Process data in formats like Parquet, ORC, JSON, CSV Collaboration & Support Work with data engineers, analysts, and business stakeholders Troubleshoot pipeline issues and provide production support Participate in Agile/Scrum processes Maintain technical documentationJob role
Job requirements
About company
Similar jobs you can apply for
Manufacturing / Production
QA / QC Analyst
Indian Academy of Competetive Exams Private LimitedWork from OfficeFull TimeMin. 3 years
Good (Intermediate / Advanced) English
Quality Control Engineer
CNC TechnicsWork from OfficeFull TimeMin. 3 yearsGood (Intermediate / Advanced) EnglishTelecouceller
Infoshare SoftWork from OfficeFull TimeAny experienceBasic English
Student Counsellor
3G HR ServicesWork from OfficeFull TimeMin. 2 yearsGood (Intermediate / Advanced) English
Web Developer
NR12Brands MarketingWork from OfficeFull TimeMin. 1 yearBasic EnglishWeb Developer
Maid ServicesWork from OfficeFull TimeAny experienceBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 2 to 5 years are eligible to apply for this job. You can apply for more jobs in Hyderabad to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Hyderabad at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Hyderabad . Through apna, you can find jobs in 64 cities across India. Join NOW!