Data Engineer - Big Data and Cloud Platforms
InfosysJob Description
Python-Spark Scala
• Primary skills:Technology->Big Data - Data Processing->Spark,Technology->Functional Programming->Scala,Technology->Machine Learning->Python Experience with cloud platforms (AWS, Azure, or GCP). Hands-on with Databricks / EMR / Spark clusters. Knowledge of streaming technologies (Kafka, Spark Streaming, Structured Streaming). Experience with workflow orchestration tools (Airflow, Oozie). Familiarity with Delta Lake / Lakehouse architecture. Exposure to NoSQL databases (MongoDB, Cassandra). Knowledge of CI/CD and DevOps practices. 5–9 years of experience in Data Engineering / Big Data development. Strong hands-on experience with Python and Apache Spark (Scala & PySpark). Deep understanding of Spark architecture (RDD, DataFrames, Spark SQL). Experience in distributed computing and big data processing. Strong knowledge of SQL and data modeling concepts. Experience with data pipeline development (ETL/ELT). Familiarity with Linux/Unix environments. Experience with version control tools (Git).Job role
Job requirements
About company
Similar jobs you can apply for
Software / Web DeveloperSoftware Developer
SHLR Technosoft
Software Developer
Cait Edusys
VB6 Developer (VB 6)
Anush InfobaseAssociate Product Manager
Tatvam Ai Labs Private LimitedIntern
TejasproQuality Control Engineer
Protoxl Design Private LimitedYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 9 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!