Kpmg India Services Llp

DevOps Manager - GenAI & Machine Learning Systems

Kpmg India Services Llp
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 5 yearsMin. 5 years

Job Description

Manager - DevOps

Description

About KPMG in India

KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India in Ahmedabad, Bengaluru, Chandigarh, Chennai, Gurugram, Jaipur, Hyderabad, Jaipur, Kochi, Kolkata, Mumbai, Noida, Pune, Vadodara and Vijayawada. 

KPMG entities in India offer services to national and international clients in India across sectors. We strive to provide rapid, performance-based, industry-focused and technology-enabled services, which reflect a shared knowledge of global and local industries and our experience of the Indian business environment.

Overview
This role demand strong GenAI experience, emerging mastery in Agentic AI Systems, and a good foundation in classical ML.
You will design and build intelligent, tool-using agents, multi-agent systems, RAG pipelines, and LLM-based applications leveraging the LangChain , LangGraph ecosystem, LangSmith for evaluation.
________________________________________
Key Responsibilities
1. GenAI / LLM Application Development
Build GenAI applications using: 
o LangChain, LangGraph
Implement RAG architectures with: 
o Retrieval, reranking, chunking, memory strategies
o Vector DBs (faiss, aisearch, opensearch, PG vector etc).
Design prompt-engineering strategies: 
o Instruction-following
o ReAct (Reasoning + Acting)
o Chain-of-thought structuring
o Self-reflection and planning loops
Evaluation Strategy
o Implement evaluation frameworks for Classical ML and GenAI systems, covering statistical validation, reliability, and robustness. 
o Assess LLM outputs, RAG pipelines, and agent workflows for grounding quality, relevance, and retrieval accuracy (e.g., recall@k, precision@k). 
o Use LangSmith for tracing, automated evaluations, regression testing, and continuous system level quality monitoring
2. Agentic System Architecture
Build agentic workflows: 
o Tool-calling agents
o Planner–executor systems
o Multi-agent communication systems
o Hierarchical agent architectures
o Deep Agents
Integrate memory systems: 
o episodic memory
o semantic memory
o vector-based long-term knowledge
Implement evaluation frameworks for agentic systems using LangSmith.
3. Model Context Protocol (MCP) & Tooling
Implement MCP servers for external tool connectivity.
Build tools that allow agents to interact with: 
o APIs
o Code execution environments
o Knowledge bases
o Company applications
4. Classical ML (Foundational DS Skills)
Apply ML models to structured/unstructured data.
Conduct feature engineering, model selection, hyperparameter tuning.
Build interpretable models where required.
5. Engineering & Integration
Collaborate with backend engineering teams to seamlessly integrate agentic and GenAI systems into production applications.
Implement observability, tracing, and monitoring for GenAI workflows using LangSmith to ensure reliability and system‑level transparency.
6. Cloud ML-Ops & Quality
ML Modelling, data drift, concept drift, model quality monitoring.
Hands‑on experience across AWS/ Azure/ Databricks, with flexibility to work on any cloud platform.
Adhere to stringent quality assurance and documentation standards using version control and code repositories (e.g., Git, GitHub, Markdown)

________________________________________
Required Skills & Experience
5–10 years total experience, with 2–4+ years hands-on GenAI.
Hands-on expertise with: 
o LangChain, LangGraph
o LangSmith (tracing, metrics, evaluations)
o MCP tooling and agent tool integration
o ReAct, Tree of Thoughts, multi-agent orchestration
o RAG patterns and vector databases
Strong coding expertise in Python.
Classical ML foundations (tree models, regression, etc.).
Experience working with LLM APIs and/or open-source LLMs.
Experience building and debugging production-quality GenAI pipelines.
Aws/azure
GIT Ops 
Prior experience building complex multi-agent systems for real-world applications.
Knowledge of multi-modal LLMs (vision, speech, code).
Familiarity with structured evaluation of LLM systems (hallucination tests, safety assessments etc ).
Experience in enterprise-grade LLM deployments.

Equal employment opportunity information 


KPMG India has a policy of providing equal opportunity for all applicants and employees regardless of their color, caste, religion, age, sex/gender, national origin, citizenship, sexual orientation, gender identity or expression, disability or other legally protected status. KPMG India values diversity and we request you to submit the details below to support us in our endeavor for diversity. Providing the below information is voluntary and refusal to submit such information will not be prejudicial to you.

Qualifications

BTech

Job role

Work location
Work locationBangalore, Bangalore - EGL Pebble Beach -KPMG, EGL Pebble Beach -KPMG, Bangalore, Karnataka, India
Department
DepartmentSoftware Engineering
Role / Category
Role / CategoryDevOps
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 5 years

About company

Name
NameKpmg India Services Llp
Job posted by Kpmg India Services Llp

Similar jobs you can apply for

Teacher / Faculty / Tutor
DQ Labs Private Limited

Arts Teacher

DQ Labs Private Limited
Indira Nagar, Bengaluru/Bangalore
₹30,000 - ₹42,000*
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English

Production Technician

Livis Infra Bees Private Limited
Yelahnaka New Town, Bengaluru/Bangalore
₹24,000 - ₹25,000
Work from Office
Full Time
Any experience
No English Required

Pharmacy Staff

Ganesh Medicals
Singasandra, Bengaluru/Bangalore
₹15,000 - ₹20,000
Work from Office
Full Time
Min. 1 year
Basic English
Blinkit Private Limited

Picker / Packer

Blinkit Private Limited
Koramangala, Bengaluru/Bangalore
₹21,000 - ₹25,000
Work from Office
Full Time
Any experience
No English Required
Bridgestone business Solutions

Collections Team Leader

Bridgestone business Solutions
Jaya Nagar, Bengaluru/Bangalore
₹25,000 - ₹50,000*
Work from Office
Full Time
Any experience
Basic English

Admission Counsellor

Vicnreal Techsol
Kalyan Nagar, Bengaluru/Bangalore
₹25,000 - ₹35,000*
Work from Office
Full Time
Min. 3 years
Good (Intermediate / Advanced) English