Artificial Intelligence Quality Assurance Engineer
Birlasoft Limited
Work from Office
Full Time
Min. 5 yearsJob Description
Contractor
Area(s) of responsibility
AI QA Engineer – Agentic AI / GenAI
Role Overview
QA Engineer responsible for validating and automating testing for Agentic AI and GenAI systems with strong Python expertise.
Key Responsibilities
- Develop Python-based automation frameworks (Pytest)
- Test LLM outputs (accuracy, hallucination, relevance)
- Validate multi-agent workflows and pipelines
- Build evaluation metrics (F1, precision, recall)
- Perform API and integration testing
- Ensure high test coverage and CI/CD integration
Required Skills
- Strong Python programming
- Automation frameworks (Pytest/unittest)
- Understanding of GenAI/LLMs
- API testing and debugging
- CI/CD and version control
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Accounts / FinanceField Installation Engineer
Airtel
Field JobFull TimeAny experience
Basic English
Process Associate
Sparkline Telecom (Opc) Private LimitedWork from OfficeFull Time
Night ShiftAny experienceGood (Intermediate / Advanced) English
Project Coordinator
DMS Unity Homes Private LimitedWork from OfficeFull TimeMin. 5 yearsGood (Intermediate / Advanced) EnglishManagement Trainee
Thames & TigerField JobFull TimeFreshers onlyBasic EnglishQA / QC Executive
V2 Innovatives Private LimitedWork from OfficeFull TimeAny experienceGood (Intermediate / Advanced) English
Project Coordinator
Prasanth Dewatering Borehole SystemField JobFull TimeNight ShiftMin. 1 yearBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!