Data Engineer
InfosysJob Description
Python, Spark Scala Developer
Technology->Analytics - Packages->Python - Big Data,Technology->Big Data - Data Processing->Spark,Technology->Big Data - Data Processing->Scala • Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience). • 5–9 years of experience in data engineering or backend development with strong hands-on delivery ownership. • Strong proficiency in Python and Apache Spark for large-scale data processing. • Solid experience with Scala for Spark-based development and production-grade implementations. • Working knowledge of Hive and SQL-based data querying/processing concepts. Data Engineering & Development • Design, develop, and maintain scalable batch/stream data pipelines using Spark with Scala and Python. • Implement efficient transformations, joins, aggregations, and data quality checks for large datasets. • Build reusable frameworks/utilities to standardize pipeline patterns and reduce delivery time. Performance & Reliability • Tune Spark jobs (partitioning, caching, shuffles, memory/executor settings) to improve performance and cost efficiency. • Troubleshoot production issues, perform root-cause analysis, and implement preventive fixes. • Ensure reliability through robust logging, monitoring hooks, and failure-handling strategies. Collaboration & Delivery • Work with stakeholders to refine requirements and deliver well-documented, production-ready solutions. • Conduct code reviews, enforce best practices, and mentor team members on Spark/Scala/Python patterns. • Contribute to CI/CD-friendly development practices including testing, version control, and release readiness.Job role
Job requirements
About company
Similar jobs you can apply for
Manufacturing / Production
Quality Control
3G HR Services
Telecaller
AM5 RoyalFront End Developer
Byot Consultancy Services Private LimitedData Analyst
Inorbit Malls (India) Private Limited
NET MVC Developer
Iotas Solutions Private Limited
Wordpress Developer
Emblix SolutionsYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 9 years are eligible to apply for this job. You can apply for more jobs in Hyderabad to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Hyderabad at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Hyderabad . Through apna, you can find jobs in 64 cities across India. Join NOW!