Fractal Analytics Private Limited

Senior Quality Assurance Engineer - Generative AI

Fractal Analytics Private Limited
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 5 yearsMin. 5 years

Job Description

Senior QA (Gen AI - Must have) Exp: 5+ Years

It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Role: Senior QA (Gen AI - Must Have)

Experience: 5+ Years

Detailed JD :

  • Design, automate, and execute API test suites (functional, contract, performance, resilience)
  • Define LLM evaluation strategies (performance testing, golden sets, guardrails, hallucination/consistency checks, relevance & latency KPIs); build automated eval pipelines tied to releases.
  • Create PDLM deliverables: verification plans/protocols, test reports, risk-based coverage, V&V trace matrices to requirements and use cases.
  • Integrate test infrastructure with Azure DevOps (CI/CD, test orchestration, quality gates, dashboards); enforce build-time gates for API and LLM quality.
  • Partner with Product, Clinical, and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.

What is required from candidate?

  • 5+ years in backend/API test automation (REST, JSON, auth), performance testing, and CI/CD.
  • Hands-on with Python/TypeScript, Postman/Newman or REST-assured, PyTest/Jest, k6/JMeter, Docker.
  • Experience validating ML/LLM systems (eval datasets, metrics, prompt/response testing, safety/guardrails).
  • Strong documentation and traceability discipline for regulated product lifecycles (PDLM/QMS).
  • Bonus: Azure DevOps pipelines, FHIR/HL7 familiarity, healthcare data privacy/security.
  • Bonus: Frontend testing capabilities are preferred, but not part of the PDLM requirements.

#LI-MA1

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Hiring Related Queries

India: HiringsupportIndia@fractal.ai

Outside India: HiringsupportROW@fractal.ai

Please share resume via job postings

Not the right fit?  Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

Experience Level

Senior Level

Job role

Work location
Work locationBengaluru, India
Department
DepartmentQuality Assurance
Role / Category
Role / CategorySoftware Quality Assurance and Testing
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 5 years

About company

Name
NameFractal Analytics Private Limited
Job posted by Fractal Analytics Private Limited

Similar jobs you can apply for

Accounts / Finance

Installation Project Engineer

Innovative Engineers
Bengaluru/Bangalore
₹25,000 - ₹45,000
Field Job
Full Time
Min. 2 years
Basic English

Safety Officer

Dmr Constructions Solutions
Muneshwara Nagar, Bengaluru/Bangalore
₹12,000 - ₹25,000
Field Job
Full Time
Any experience
Basic English
One World Manufacturing

Production Supervisor

One World Manufacturing
Ragavendra Nagar, Bengaluru/Bangalore
₹23,000 - ₹27,000*
Field Job
Full Time
Any experience
No English Required
Dhruthi Aaradhya Design Studio

Factory Manager

Dhruthi Aaradhya Design Studio
SMV Layout, Bengaluru/Bangalore
₹40,000 - ₹65,000
Work from Office
Full Time
Min. 2 years
No English Required
Tact Sales and Services

Electrical Engineer

Tact Sales and Services
Bommanahalli, Bengaluru/Bangalore
₹15,000 - ₹25,000
Field Job
Full Time
Freshers only
Basic English
Mervice Infotech Private Limited

QA / QC Executive

Mervice Infotech Private Limited
BTM Layout, Bengaluru/Bangalore
₹15,000 - ₹18,800
Work from Office
Full Time
Any experience
Basic English