JP Morgan Services India Pvt Ltd

Lead Software Engineer- AI Agent Developer

JP Morgan Services India Pvt Ltd
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 8 yearsMin. 8 years

Job Description

Lead Software Engineer- AI Agent Developer

Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team.

We’re seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. You’ll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures.

Job responsibilities 

  • Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime).
  • Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution).
  • Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution).
  • Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching).
  • Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis).
  • Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response).
  • Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency).
  • Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence).

 

Required qualifications, capabilities and skills 

  • 8+ years of software engineering experience, including leading design and delivery of large-scale production systems.
  • Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements.
  • Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns.
  • Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs)
  • Proven expertise in context and memory engineering, model evaluation methodologies, and quality measurement.
  • Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness).
  • Strong programming skills in one or more of: Python, Java, Go, or TypeScript; plus strong API and distributed-systems fundamentals.
  • Familiarity with retrieval systems, vector databases, and hybrid search patterns.

 

 

Preferred qualifications, capabilities and skills 

  • Agentic AI architecture: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows
  • LLM/foundation model expertise: prompting strategies, tool-augmented generation, model behavior understanding
  • Context & memory engineering: short/long-term memory, summarization, retrieval grounding, caching strategies
  • Knowledge graphs: Neo4J (preferred), Open Knowledge Formats (OKFs)
  • Retrieval systems: vector databases, hybrid search patterns

Job role

Work location
Work locationBengaluru, 00636-JPMorgan Chase & Co Tower D, , Block D, Parcel 8, Embassy Tech Village, Outer Ring Road, Devarabeesanahalli Village, Bengaluru, Karnataka, India
Department
DepartmentSoftware Engineering
Role / Category
Role / CategorySoftware Development
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 8 years

About company

Name
NameJP Morgan Services India Pvt Ltd
Job posted by JP Morgan Services India Pvt Ltd

Similar jobs you can apply for

Software / Web Developer
Aarnatek Kiosk

Android Developer

Aarnatek Kiosk
Marathahalli, Bengaluru/Bangalore
₹40,000 - ₹80,000
Work from Office
Full Time
Min. 2 years
Good (Intermediate / Advanced) English

Quality Control Engineer

M/S S K Manpower Solutions
Peenya, Bengaluru/Bangalore
₹25,000 - ₹45,000
Work from Office
Full Time
Min. 6 months
Basic English

VMC Programmer

Distinctive Engineering
Hegganahalli, Bengaluru/Bangalore
₹35,000 - ₹55,000
Work from Office
Full Time
Any experience
Basic English

Software Developer

Toodles Fun And Learning Centre
Koramangala, Bengaluru/Bangalore
₹35,000 - ₹45,000
Work from Office
Full Time
Any experience
Basic English
Clearcred Technology Private Limited

Full-stack Developer

Clearcred Technology Private Limited
Pulikeshi Nagar, Bengaluru/Bangalore
₹45,000 - ₹80,000
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English

Engineering Trainee

Sunil S Shetty
Electronics City, Bengaluru/Bangalore
₹15,000 - ₹20,000
Work from Office
Full Time
Any experience
Basic English

You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

The candidate should have completed the required education and people who have 8 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.

The candidate should have sound communication skills and sound communication skills for this job.

Both Male and Female candidates can apply for this job.

No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.

No work-related deposit needs to be made during your employment with the company.

Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!