Senior Databricks Engineer - Big Data & Cloud

EY - GDS Consulting- NF - AI And DATA - Databricks - Senior

At EY, we’re all in to shape your future with confidence. 

We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. 

Join EY and help to build a better working world. 

 

EY GDS – AI & Data – Databricks

 

We’re looking for candidates with strong technology and data understanding in the big data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team.

 

 

Your key responsibilities

 

• Develop & deploy Databricks in a cloud environment
• ETL design, development, and deployment to Cloud Service
• Interact with Onshore, understand their business goals, contribute to the delivery of the workstreams
• Design and optimize model codes for faster execution
• Collaborate with cross-functional teams to manage project timelines and deliverables

 

 

Skills and attributes for success

 

• 3 to 5 years of experience in Python (Classes, functions, modules, debugging, error handling)
• Strong experience in SQL (Joins, subqueries, window functions, CTEs, stored procedures)
• Knowledge of (RDD, DataFrames, Spark SQL) – good to have
• Experience working with at least one cloud platform (AWS/Azure/GCP)
• Foundation-level certification in cloud technologies (preferred: Azure Data Engineer Associate, AZ 900, DP 900, AWS Cloud Practitioner, GCP Cloud Digital Leader)
• Essential DevOps practices like commits, pull requests, code versioning etc
• Good understanding of data Lakehouse concepts
• Strong communication and problem solving skills

 

 

To qualify for the role, you must have

 

• Be a computer science graduate or equivalent with 3-5 years of industry experience
• Have working experience in an Agile-based delivery methodology (preferable)
• Flexible and proactive/self-motivated working style with strong personal ownership of problem resolution
• Strong analytical skills and enjoys solving complex technical problems
• Proficiency in software development best practices
• Excellent debugging and optimization skills
• Experience in enterprise-grade solution implementations & in converting business problems/challenges to technical solutions considering security, performance, scalability, etc.
• Excellent communicator (written and verbal, formal and informal)
• Participate in all aspects of solution delivery life cycle including analysis, design, development, testing, production deployment, and support
• Client management skills

 

EY | Building a better working world

EY is building a better working world by creating new value for clients, people, society and the planet, while building trust in capital markets.

Enabled by data, AI and advanced technology, EY teams help clients shape the future with confidence and develop answers for the most pressing issues of today and tomorrow.

EY teams work across a full spectrum of services in assurance, consulting, tax, strategy and transactions. Fueled by sector insights, a globally connected, multi-disciplinary network and diverse ecosystem partners, EY teams can provide services in more than 150 countries and territories.

Experience Level

Senior Level