Senior Quality Assurance Engineer - Generative AI
Fractal Analytics Private Limited
Work from Office
Full Time
Min. 5 yearsJob Description
Senior QA (Gen AI - Must have) Exp: 5+ Years
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Role: Senior QA (Gen AI - Must Have)
Experience: 5+ Years
Detailed JD :
- Design, automate, and execute API test suites (functional, contract, performance, resilience)
- Define LLM evaluation strategies (performance testing, golden sets, guardrails, hallucination/consistency checks, relevance & latency KPIs); build automated eval pipelines tied to releases.
- Create PDLM deliverables: verification plans/protocols, test reports, risk-based coverage, V&V trace matrices to requirements and use cases.
- Integrate test infrastructure with Azure DevOps (CI/CD, test orchestration, quality gates, dashboards); enforce build-time gates for API and LLM quality.
- Partner with Product, Clinical, and R&D to refine requirements and acceptance criteria; ensure summaries render correctly for different user roles and workflows.
What is required from candidate?
- 5+ years in backend/API test automation (REST, JSON, auth), performance testing, and CI/CD.
- Hands-on with Python/TypeScript, Postman/Newman or REST-assured, PyTest/Jest, k6/JMeter, Docker.
- Experience validating ML/LLM systems (eval datasets, metrics, prompt/response testing, safety/guardrails).
- Strong documentation and traceability discipline for regulated product lifecycles (PDLM/QMS).
- Bonus: Azure DevOps pipelines, FHIR/HL7 familiarity, healthcare data privacy/security.
- Bonus: Frontend testing capabilities are preferred, but not part of the PDLM requirements.
#LI-MA1
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Hiring Related Queries
India: HiringsupportIndia@fractal.ai
Outside India: HiringsupportROW@fractal.ai
Please share resume via job postings
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Manufacturing / Production
Quality Assurance Officer
Jai Finance India LimitedWork from OfficeFull TimeMin. 1 year
Good (Intermediate / Advanced) EnglishProject Manager
Urban Line Constructions and Projects LLPWork from OfficeFull TimeMin. 3 yearsBasic English
Maintenance Engineer
Ace Carbo NitridersWork from OfficeFull TimeAny experienceBasic EnglishStore Incharge
Ace Carbo NitridersWork from OfficeFull TimeMin. 2 yearsGood (Intermediate / Advanced) EnglishCNC Programmer
Recruitify Jm Hr Solutions Private LimitedWork from OfficeFull TimeAny experienceBasic EnglishQuality Engineer
Ace Carbo NitridersWork from OfficeFull TimeAny experienceBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!