Custom Software Engineer - Azure Databricks Specialist

Custom Software Engineer

Project Role : Custom Software Engineer
Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs.
Must have skills : Microsoft Azure Databricks
Good to have skills : NA
Minimum 7.5 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As a Custom Software Engineer, Build and operate scalable Lakehouse pipelines on Databricks/Azure. Own ELT/streaming, Delta Lake optimization, Unity Catalog governance, and CI/CD. Integrate ADLS/ADF/Synapse, and deliver high-quality data sets for BI/ML/GenAI.
You will engage in the development of custom software solutions that involve designing, coding, and enhancing various components across systems or applications. Your typical day will include collaborating with cross-functional teams, utilizing modern frameworks, and applying agile practices to deliver scalable and high-performing solutions that meet specific business requirements. You will be involved in the entire software development lifecycle, ensuring that the solutions you create are not only functional but also optimized for performance and user experience.

Roles & Responsibilities:
- Expected to be an SME.
- Collaborate and manage the team to perform.
- Responsible for team decisions.
- Engage with multiple teams and contribute on key decisions.
- Provide solutions to problems for their immediate team and across multiple teams.
- Mentor junior team members to enhance their skills and knowledge.
- Continuously evaluate and improve development processes to increase efficiency.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in Microsoft Azure Databricks, PySpark, SQL, Databricks (Delta, DLT/Workflows), Azure data services, Unity Catalog, CI/CD, ML flow/Feature Store, Power BI, streaming/CDC, vector search/RAG, Terraform.
- Good To Have Skills: Experience with cloud computing platforms such as AWS or Google Cloud.
- Strong understanding of software development methodologies, particularly Agile and DevOps.
- Experience with programming languages such as Python, Java, or Scala.
- Familiarity with data engineering concepts and data pipeline development.

Additional Information:
- The candidate should have minimum 7.5 years of experience in Microsoft Azure Databricks.
- This position is based at our Pune office.
- A 15 years full time education is required.