Specialist - Data Engineering
Larsen & Toubro Infotech Ltd (LTI)Job Description
Specialist - Data Engineering
Minimum 5 to 7 years of IT experience with handson expertise in Databricks on AWS
Proficient in leveraging Databricks features such as
oDelta Lake
oUnity Catalog
oScalable data processing frameworks
Strong understanding of AWS cloud services including
oAmazon S3
oAWS Lambda
oAmazon SNS
oAWS Step Functions
oAWS Glue
Skilled in job cost optimization techniques to
oMinimize runtimes
oImprove system performance
Experience with
oPython core libraries
oPySpark for data engineering tasks
Good analytical and problemsolving skills with expertise in
oSQL query development
oStored procedures
oCreating data marts and views in RDBMS
Strong understanding of
oETL concepts
oEndtoend data pipeline architecture
oData warehouse and reporting layers
Familiarity with CICD pipelines and deployment tools such as
oTerraform
Experience with version control systems
oGitHub or equivalent platforms
Understanding of
oAgile methodology
oSoftware Development Life Cycle SDLC
Excellent communication and presentation skills with the ability to collaborate effectively with stakeholders
Roles Responsibilities
Collaborate with business users and stakeholders to understand challenges and provide effective Databricksbased solutions
Research and evaluate new Databricks features conduct Proof of Concepts POCs and develop best practice documentation
Provide support for Sparkrelated issues and participate in code reviews offering recommendations for improvement
Lead and mentor junior team members guiding them in development and troubleshooting activities
Manage midsized teams and oversee delivery of work ensuring quality and timely completion
Take ownership of assigned tasks and contribute effectively in an Agile environment
Participate in solution design discussions and prepare designdocumentation artifacts based on requirements
Drive job cost optimization and performance tuning initiatives to enhance system efficiency
Support CICD processes and infrastructure automation to streamline deployments
Actively participate in Agile ceremonies and contribute to continuous improvement of team collaboration and productivity
Job role
Job requirements
About company
Similar jobs you can apply for
Software / Web Developer
Data Analyst, Data Science
Technobrilliant Learning SolutionsSoftware / Web Developer Intern
Vedantix Softwares
Telecaller
Bike Bazaar FinanceSoftware Engineer Intern
Eventdtl Private LimitedSoftware Developer
Vedantix Softwares
Front-end Developer (React.js)
ERP ConsultingYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 7 years are eligible to apply for this job. You can apply for more jobs in Pune to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Pune at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Pune . Through apna, you can find jobs in 64 cities across India. Join NOW!