Infosys

Pyspark databricks

Infosys
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 2 yearsMin. 2 years

Job Description

Pyspark databricks

Design, develop, and maintain ETL/ELT pipelines using PySpark and Databricks. Build scalable data processing solutions for large datasets. Develop and optimize Spark jobs for performance and efficiency. Implement data ingestion pipelines from various structured and unstructured data sources. Work with Delta Lake, Data Lake, and cloud storage solutions. Collaborate with business stakeholders, data analysts, and architects to understand data requirements. Ensure data quality, governance, and security standards are followed. Troubleshoot performance issues and optimize data workflows. Participate in code reviews and follow DevOps best practices. Required Skills Technical Skills Strong experience with PySpark and Apache Spark. Hands-on experience with Databricks. Proficiency in Python programming. Experience in building ETL pipelines and data transformations. Strong SQL knowledge and query optimization skills. Experience with Azure Data Factory (ADF) / AWS Glue or similar tools. Knowledge of Delta Lake, Medallion Architecture, and Data Lakes. Experience with Git, CI/CD pipelines, and Agile methodologies.

Job role

Work location
Work locationBANGALORE
Department
DepartmentData Science & Analytics
Role / Category
Role / CategoryDBA / Data warehousing
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 2 years

About company

Name
NameInfosys
Job posted by Infosys

Similar jobs you can apply for

Accounts / Finance
Ison Xperiences India Private Limited

Database Analyst

Ison Xperiences India Private Limited
HSR Layout, Bengaluru/Bangalore
₹48,000 - ₹60,000
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English

Software Developer

Vijaya Vinayak Chitfunds Private Limited
Banashankari, Bengaluru/Bangalore
₹20,000 - ₹40,000
Work from Office
Full Time
Min. 2 years
Basic English
Sriameya Projects India

QA/QC Engineer

Sriameya Projects India
Electronics City, Bengaluru/Bangalore
₹30,000 - ₹45,000
Work from Office
Full Time
Min. 3 years
Good (Intermediate / Advanced) English
Skeltron Info Solutions

Wordpress Developer

Skeltron Info Solutions
Jaya Nagar, Bengaluru/Bangalore
₹8,000 - ₹13,000*
Work from Office
Full Time
Freshers only
No English Required
Schematonics Research And Development India (Opc) Private Limited

Dot Net Developer

Schematonics Research And Development India (Opc) Private Limited
BTM Layout, Bengaluru/Bangalore
₹14,000 - ₹14,000
Work from Office
Full Time
Freshers only
Good (Intermediate / Advanced) English

Full-Stack Developer Intern

Sarvasthi Technologies Private Limited
Sahakara Nagar, Bengaluru/Bangalore
₹12,000 - ₹15,000
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English

You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

The candidate should have completed the required education and people who have 2 to 14 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.

The candidate should have sound communication skills and sound communication skills for this job.

Both Male and Female candidates can apply for this job.

No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.

No work-related deposit needs to be made during your employment with the company.

Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!