AI Quality Engineer

AI Quality Engineer: Global Analytic

Job Title:

AI Quality Engineer: Global Analytic

Job Description

We’re Concentrix. A new breed of tech company — Human-centered. Tech-powered. Intelligence-fueled.

We create game-changing solutions across the enterprise, that help brands grow across the world and into the future. We are trusted by clients across all major sectors, from up-and-coming success stories to iconic Fortune Global 500 brands in over 70 countries spanning 6 continents.

Our game-changers:

* Challenge Conventions

* Deliver outcomes unimagined

* Create experiences that go beyond WOW

If this is you, we would love to discuss career opportunities with you.

In our Information Technology and Global Security team, you will deliver the latest technology infrastructure, transformative software solutions and industry-leading global security for our staff and clients. You will work with the best in the world to design, implement and strategize IT, security, application development, innovation, and solutions in today’s hyperconnected world. You will be part of the technology team that is core to our vision of develop, build and run the future of CX.

Concentrix provides eligible employees with an opportunity to enroll in many benefit programs, generally including private medical plans, great compensation package, retirement savings plans, paid learning days, and flexible workplaces. Specific benefits plans will vary by country/region.

We’re a remote-first company looking for the absolute best talent in the world. Experience the power of a game-changing career.

#LI-Onsite

We are a dedicated data and analytics team that provides support to one of our top Australian clients. Our primary focus is on collaborating with Operations and the Client to Design, Build, and Execute strategies that enhance customer experience (CX) and employee experience (EX). Additionally, we work closely with cross-functional teams, leveraging global best practices to equip Operations with valuable insights and tools. By partnering with various stakeholders, we aim to optimize operational efficiency and drive continuous improvement in service delivery.

Duties and Responsibilities:
Develop and implement comprehensive testing strategies for AI models and systems.

• Design and execute test cases to evaluate the accuracy, performance, and reliability of AI models.

• Automate testing processes to streamline quality assurance workflows and improve efficiency.

• Collaborate with data scientists, AI researchers, and software engineers to understand model functionality and identify testing requirements.

• Monitor and analyze test results, identify defects and issues, and work with the development team to resolve them.

• Conduct performance testing to ensure AI models operate efficiently under various conditions and workloads.

• Stay updated with the latest advancements in AI and testing methodologies to continuously improve testing practices.

• Provide detailed documentation of testing processes, methodologies, and results.

• Ensure compliance with industry standards and best practices for AI quality assurance.

Experience – 5 to 8 Years

Location – Bangalore Client location

Mode of Work – Work from office

Automation Tester who has tested AI Products

• Product Testing Strategy - someone who has worked upon

• API testing, Automation Framework, BDD, Python + Behave, Git Version Control, Evaluation reporting and communication, CI/CD Integration.

• LLM Evaluation and Testing for Accuracy, relevance, and context of responses or outputs, Feedback mechanism and continuous validation

• Testing for Bias, Safety and non-subjective response handling / fall back

• Basic perf testing p50/ p95, response time SLA, load testing

• Data storage, traceability, and auditability. 

• Handling edge cases, harmful prompts, etc.

• Any legal framework application for testing before production

Location:

IND Bangalore - 1st Floor Block G4 Aspen Building, Embassy Manyata Business Park

Language Requirements:

Time Type:

Full time

Experience Level

Senior Level