LLM Operations Engineer

LLM Operations Engineer

Project Role : LLM Operations Engineer
Project Role Description : Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.
Must have skills : Generative AI, Large Language Models (LLMs), Machine Learning Operations, Agentic AI
Good to have skills : NA
Minimum 3 year(s) of experience is required
Educational Qualification : 15 years full time education

Summary:
As an LLM Operations Engineer, your day involves leveraging cloud-native platforms and tools to deploy large language models in a scalable and efficient manner. You continuously monitor the performance of these models, proactively identifying and resolving operational issues to maintain smooth functionality. Ensuring that all AI operations adhere to compliance and security protocols is a key part of your routine. Collaboration with various teams to support the deployment lifecycle and optimize system reliability forms an integral part of your daily activities, contributing to the overall success of AI initiatives within the organization.

Roles & Responsibilities:
- Expected to perform independently and become an SME.
- Required active participation/contribution in team discussions.
- Contribute in providing solutions to work related problems.
- Collaborate with cross-functional teams to streamline deployment processes and improve operational workflows.
- Continuously evaluate and implement best practices to enhance system performance and reliability.
- Assist junior team members by sharing knowledge and providing guidance on operational tasks.
- Document operational procedures and maintain clear communication channels to support team efficiency.

Professional & Technical Skills:
- Must To Have Skills: Proficiency in Generative AI, Machine Learning Operations, Large Language Models (LLMs), Agentic AI.
- Strong experience with cloud-native services and infrastructure for AI model deployment and management.
- In-depth understanding of monitoring tools and techniques to track model performance and system health.
- Knowledge of security frameworks and compliance requirements relevant to AI operations.
- Ability to troubleshoot and resolve complex operational challenges in AI environments.
- Familiarity with automation and orchestration tools to support scalable AI workflows.

Additional Information:
- The candidate should have minimum 3 years of experience in Generative AI.
- This position is based at our CDC2E - SEZ location.
- A 15 years full time education is required.