Lead Data Engineer - Data Engineering, Databricks, Model Serving, ML Ops, Data Architecture and modeling
JP Morgan Services India Pvt LtdJob Description
Lead Data Engineer - Data Engineering, Databricks, Model Serving, ML Ops, Data Architecture and modeling
Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.
As a Lead Data Engineer at JPMorganChase within the Consumer and Community Banking , you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firm’s business objectives.
Job responsibilities
- Architects and maintains large-scale data pipelines using Apache Spark and related distributed computing frameworks, ensuring efficient processing of structured and unstructured data.
- Builds and optimizes both batch and streaming data workloads to support analytical and operational use cases.
- Develops, optimizes, and productionizes notebooks, jobs, and workflows within the Databricks environment to support analytical and machine learning use cases.
- Designs and implements data architecture and data modeling strategies, including dimensional models, lakehouse structures, and schema design that balance performance, scalability, and governance requirements.
- Writes and optimizes complex SQL queries for data transformation, validation, and performance tuning across large datasets.
- Supports ML model serving infrastructure, ensuring trained models are deployed, monitored, and scaled reliably in production environments.
- Collaborates closely with data scientists and ML engineers on MLOps practices, including model versioning, CI/CD pipelines for ML artifacts, monitoring, and automated retraining workflows.
- Partners with cross-functional stakeholders — including analytics, risk, and platform engineering teams — to translate business requirements into technical data solutions.
- Maintains strong data quality, lineage, and security standards consistent with data governance and compliance expectations.
- Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.
- Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation
Required qualifications, capabilities, and skills
- Formal training or certification on data engineering concepts and 5+ years applied experience
- Demonstrates strong, hands-on proficiency with Apache Spark or comparable distributed compute frameworks, including experience optimizing jobs for performance and cost at scale.
- Demonstrates hands-on exposure to distributed computing, cloud data platforms, and production ML infrastructure.
- Holds direct, production-level experience with Databricks, including notebooks, Delta Lake, job orchestration, and cluster management.
- Demonstrates solid command of SQL, with the ability to write, debug, and optimize complex queries against large and varied datasets.
- Brings practical experience supporting ML model serving infrastructure in production environments and shows familiarity with MLOps tooling and practices, such as model monitoring, versioning, and deployment automation.
- Possesses a strong foundation in data architecture and data modeling, covering both operational and analytical data store design.
- Has working knowledge of cloud data platforms such as AWS, Azure, or GCP.
- Maintains proficiency with version control systems such as Git.
- Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices
Preferred qualifications, capabilities, and skills
- Experience with Airflow or Databricks Workflows, Docker and Kubernetes, and CI/CD pipelines for data and machine-learning workflows.
- Familiarity with feature stores and model registries such as MLflow, and experience with real-time streaming architectures such as Kafka and Spark Structured Streaming.
- Prior experience in financial services or another highly regulated industry, with an understanding of data governance and compliance requirements.
Job role
Job requirements
About company
Similar jobs you can apply for
Manufacturing / Production
QA/QC Engineer
Human Capital
Sales Tele
Aimax Provider
Software Engineer
Total Solar Technologies Private Limited
Quality Engineer
Godrej & Boyce Manufacturing Co LtdWeb Developer
Promage Innovations LLPWebsite Developer
Asha Tea CompanyYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Mumbai/Bombay to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Mumbai/Bombay at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Mumbai/Bombay . Through apna, you can find jobs in 64 cities across India. Join NOW!