AI Model Integration Testing Manager

Manager

KPMG Delivery Network (KDN) AI Foundry is seeking a skilled and detail-oriented professional to join its dynamic team as a tester. This role is critical in ensuring that AI models are seamlessly integrated into business applications and workflows, delivering reliable and high-quality functionality across diverse use cases. The ideal candidate will possess a strong understanding of software testing principles, AI model behavior, and system integration practices.

Key responsibilities include:

1. AI Model Integration Validation

oEnsure AI models are correctly embedded into application workflows/systems.oValidate input/output data formats and compatibility with application interfaces.oCollaborate with data scientists to understand model inputs, outputs, and any potential biases or edge cases that need specific testing.oCollaborate with developers to troubleshoot integration issues.

2. Functional Testing of AI Features

oDesign and execute test cases to verify AI-driven functionalities.oValidate that AI outputs align with expected business logic and user requirements.oPerform regression testing to ensure new AI features don’t break existing functionality.

3. Test Automation and Tooling

oDevelop automated test scripts for continuous integration pipelines.oUtilize tools like Selenium, Postman, or custom scripts to test APIs and UI components.oMaintain and update test suites as models and applications evolve.

4. Performance and Reliability Testing

oAssess AI model response times and system performance under load.oMonitor for latency, throughput, and resource utilization during AI operations. 

5. Documentation and Reporting

oDocument test plans, test cases, and test results clearly and comprehensively.oProvide feedback and reports to development and data scien ce teams.oTrack and manage defects using tools like JIRA or Azure DevOps.

Educational Qualifications

oBachelor’s degree in Business Administration, Engineering, Computer Science, Data Science, Business Analytics, or a related field. A Master’s degree or MBA is a plus.

 

Work Experience

o8+ years of experience in software testing, with a strong focus on integration and functional testing.oSolid understanding of software testing methodologies, tools, and processes.oProficiency with AI and machine learning frameworks (e.g., TensorFlow, PyTorch).oStrong understanding of cloud platforms (e.g., AWS, Azure, Google Cloud) and their AI services.oProficiency in using bug tracking and test management tools (e.g., Jira, Azure DevOps).oExperience with API testing tools (e.g., Postman), SQL for database testing

 

Skills

oFamiliarity with cloud platforms (Azure, AWS, GCP) and their data services.oExcellent analytical, problem-solving, and communication skills for cross-functional collaboration.oAbility to document clear, concise, and comprehensive test plans and test casesoAbility to leverage automated testing frameworks & toolsoExcellent communication and collaboration skills, with the ability to work effectively in a team environment

Experience Level

Mid Level