Kpmg India Services Llp

AI Agent Testing Specialist

Kpmg India Services Llp
Gurgaon/Gurugram
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 1 yearMin. 1 year

Job Description

Executive

KPMG is currently seeking an AI Agent Testing Specialist to join our Legal, Regulatory and Compliance organization.

•Execute structured test plans aligned with AI Agent Building Code and acceptance criteria.
•Validate knowledge grounding to ensure responses use approved, current sources only.
•Ensure adherence to instructions, guardrails, boundaries, and escalation protocols.
•Test output quality for accuracy, completeness, consistency, and hallucination risks.
•Conduct security checks including prompt injection, jailbreak, and data exposure testing.
•Validate agent workflows, including source selection, fallback, and ambiguity handling.
•Maintain comprehensive testing evidence, including results, defects, and sign-offs.
•Support regression testing following changes to prompts, models, tools, or configurations.
•Identify recurring issues and escalate defects to developers and stakeholders.
•Contribute to continuous improvement via monitoring, reusable test assets, and collaboration.

Mandatory  technical & functional skills

•Bachelor’s degree in business, technology, data analytics, computer science, engineering, risk management, or related field
•1–3 years of experience in QA, testing, risk, data analytics, business analysis, or AI/automation support
•Experience executing test scripts, documenting results, identifying defects, and tracking remediation
•Strong attention to detail to assess accuracy, completeness, and alignment of AI outputs
•Ability to follow structured testing protocols and identify edge cases or control gaps
•Strong written communication skills for documenting test evidence, defects, and observations
 

Preferred technical & functional skills

•Familiarity with AI tools, generative AI, LLM workflows, chatbots, or agent-based solutions
•Experience working with global (U.S.-based) stakeholders and managing multiple priorities
•Understanding of risk management concepts, control frameworks, or professional services environments
•Hands-on experience with Microsoft 365, SharePoint, Excel, PowerPoint, Teams, Copilot, or similar tools
•Awareness of data privacy, confidentiality, access control, and responsible AI principles
•Ability to analyze AI outputs critically for grounding, consistency, and reliability

Experience Level

Executive Level

Job role

Work location
Work locationGurgaon, Haryana, India
Department
DepartmentLegal & Regulatory
Role / Category
Role / CategoryRisk Management - Assessment / Advisory
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 1 year

About company

Name
NameKpmg India Services Llp
Job posted by Kpmg India Services Llp

Similar jobs you can apply for

Accounts / Finance

Tally Accountant

Zade Infra Builders LLP
Palam Vihar, Gurgaon/Gurugram
₹15,000 - ₹20,000
Work from Office
Full Time
Min. 6 months
Basic English
Compass Group

Commis (Commi 1 / 2 / 3)

Compass Group
Sector 74A, Gurgaon/Gurugram
₹15,000 - ₹25,000
Work from Office
Full Time
Any experience
Basic English

Store Sales Executive

Gshops Retailer Private Limited
Gurgaon/Gurugram
₹12,000 - ₹22,000*
Work from Office
Full Time
Min. 1 year
Basic English
Teleperformance

Chat Support Representative

Teleperformance
Gurgaon/Gurugram
₹25,000 - ₹27,000
Work from Office
Full Time
Min. 6 months
Good (Intermediate / Advanced) English
Torolox India

Account Assistant

Torolox India
Sector 74A, Gurgaon/Gurugram
₹18,000 - ₹23,000
Work from Office
Full Time
Min. 1 year
Basic English

Cafe Manager

Easyway Marketing
Sector 99, Gurgaon/Gurugram
₹20,000 - ₹45,000
Work from Office
Full Time
Min. 2 years
Good (Intermediate / Advanced) English

You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

The candidate should have completed the required education and people who have 1 to 3 years are eligible to apply for this job. You can apply for more jobs in Gurgaon/Gurugram to get hired quickly.

The candidate should have sound communication skills and sound communication skills for this job.

Both Male and Female candidates can apply for this job.

No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Gurgaon/Gurugram at apna.

No work-related deposit needs to be made during your employment with the company.

Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Gurgaon/Gurugram . Through apna, you can find jobs in 64 cities across India. Join NOW!