Senior Principal Consultant - Generative AI Technical Lead

Ready to build the future with AI?  

At Genpact, we don’t just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges.  

If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.  

Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. 

Inviting applications for the role of Senior Principal consultant GenAI LLM Ops Engineer! 

 We’re looking for an LLM Ops Engineer to build, operate, and scale our Large Language Model platforms and applications. You’ll own the end-to-end operational lifecycle—from model deployment and orchestration to reliability, observability, safety, cost optimization, and performance tuning. You’ll partner closely with Data Science, MLOps, Security, and Product teams to deliver robust, compliant, and efficient LLM-powered experiences. 

Responsibilities  

1. Architect secure, reusable, and modular infrastructure-as-code (IaC) frameworks for GenAI and LLM operations 

2. Design, deploy, and maintain LLM serving infrastructure (e.g., Azure OpenAI, self-hosted OSS models, vector databases).  

3. Implement model orchestration (routing, ensemble strategies, fallbacks, retries, cache layers).  

4. Build CI/CD pipelines for prompt catalogs, model configurations, guardrails, and evaluation suites.  

5. Define and track LLM-specific SLOs (latency, response quality, safety violations, hallucination rate).  

6. Implement telemetry (traces, logs, metrics, prompt/response analytics) and A/B experiments.  

7. Establish alerting & incident response playbooks. 

8. Lead the development and standardization of CI/CD pipelines for AI/ML model deployment 

9. Ensure security, privacy, and regulatory compliance (data residency, consent, auditability).  

10. Manage prompt governance (versioning, approval workflow, change logs, rollback). 

11. Define and enforce best practices for model versioning, governance and lifecycle management 

12. Troubleshoot and resolve issues related to LLM deployment, scaling, and performance 

13. Stay updated with advancements in MLOps, LLMs, and GenAI technologies 

Qualifications we seek in you! 

Minimum Qualifications  

• Bachelor’s degree in Computer Science, Engineering, or a related field 

• Proven experience in MLOps, DevOps, or AI/ML infrastructure roles 

• Hands-on experience with CI/CD pipelines, containerization, and orchestration tools (e.g., Docker, Kubernetes) 

• Proficiency in scripting and programming languages such as Python, Bash, or similar 

• Experience with cloud platforms (AWS, Azure, GCP) and infrastructure-as-code tools (Terraform, CloudFormation) 

• Strong understanding of machine learning model lifecycle management and operationalization 

• Knowledge of data privacy, security, and compliance standards in AI/ML environments 

Preferred Qualifications,  

• Master’s degree in a relevant field 
• Experience with large language models (LLMs) and generative AI frameworks 
• Familiarity with monitoring, logging, and observability tools for AI/ML workloads 
• Experience collaborating with cross-functional teams in enterprise environments 
• Excellent problem-solving, communication, and documentation skills 
• Prior experience mentoring or leading technical teams 

Why join Genpact?  

• Lead AI-first transformation – Build and scale AI solutions that redefine industries  

• Make an impact – Drive change for global enterprises and solve business challenges that matter  

• Accelerate your career—Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills  

• Grow with the best – Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace  

• Committed to ethical AI – Work in an environment where governance, transparency, and security are at the core of everything we build  

• Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress  

Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.   

Let’s build tomorrow together.  

Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.   
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.