Large Language Model and Retrieval-Augmented Generation Engineer

Indium Software India
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 5 yearsMin. 5 years

Job Description

Data Scientist

Job Description – LLM / RAG Engineer

We are looking for a skilled LLM / RAG Engineer to design, build, and operate production-grade AI systems using large language models. The ideal candidate will have strong hands-on experience with RAG architectures, data preparation, evaluation, and LLMOps, along with the ability to deliver reliable and user-friendly conversational applications.

Key Responsibilities:

LLM Fundamentals

• Understand how LLMs generate text and common failure modes such as hallucinations and context limitations • Design effective prompts including system prompts, grounding techniques, and few-shot examples • Differentiate between embedding and generation models • Decide when to use RAG vs. fine-tuning

RAG Architecture (Critical)

• Design and implement semantic and structure-aware chunking strategies • Build vector and hybrid search pipelines • Implement query rewriting, top-k selection, and re-ranking • Apply metadata filtering and enable citations for grounded responses

Unstructured Data Processing

• Extract text from PDFs, DOCX, HTML, and OCR sources • Perform data cleaning, deduplication, and normalization • Prepare chunk-ready datasets with rich metadata

Structured Data & Analytics

• Strong SQL proficiency • Implement text-to-SQL workflows with guardrails • Enable schema-aware retrieval and analytical querying • Combine computed results with clear LLM-generated explanations

Evaluation & Monitoring

• Measure retrieval relevance and answer groundedness • Build offline evaluation datasets with human review • Monitor latency, cost, and response quality in production

LLMOps

• Manage prompt and model versioning • Support rollbacks and safe deployments • Track cost, performance, and system reliability

Frontend & Conversational UX

• Design conversational experiences with follow-up handling • Implement citations and confidence indicators in responses • Build lightweight frontends using Flask • Capture and utilize user feedback for continuous improvement

Required Skills

• Strong understanding of LLM and RAG systems • Experience with vector databases and retrieval pipelines • Solid SQL and data handling expertise • Hands-on experience with Flask-based applications • Strong problem-solving, communication, and system design skills

Experience Level

Senior Level

Job role

Work location
Work locationBangalore North, India
Department
DepartmentData Science & Analytics
Role / Category
Role / CategoryData Science & Machine Learning
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 5 years

About company

Name
NameIndium Software India
Job posted by Indium Software India

Similar jobs you can apply for

Logistics/ Warehouse operations
Packaid Ecopack Private Limited

Quality Assistant

Packaid Ecopack Private Limited
Margondanahalli, Bengaluru/Bangalore
₹16,000 - ₹22,000*
Work from Office
Full Time
Any experience
Basic English

Quality Control Engineer

Pragathi IT Solutions
Peenya, Bengaluru/Bangalore
₹18,000 - ₹22,000
Work from Office
Full Time
Night Shift
Freshers only
Basic English
Big Basket

LOSS PREVENTION ASSOCIATE - HARLUR AND RAYASANDRA

Big Basket
Electronics City, Bengaluru/Bangalore
₹20,000 - ₹30,000
Work from Office
Full Time
Min. 6 months
Basic English
Edizi Tools Private Limited

Quality Assurance Executive

Edizi Tools Private Limited
Electronics City, Bengaluru/Bangalore
₹19,000 - ₹24,000*
Work from Office
Full Time
Freshers only
Good (Intermediate / Advanced) English

Automation Test Engineer

MNC company
Kumaraswamy Layout, Bengaluru/Bangalore
₹1,20,000 - ₹1,49,999
Work from Office
Full Time
Min. 5 years
Good (Intermediate / Advanced) English
Future Revolution

Wordpress Developer

Future Revolution
Vijaya Nagar, Bengaluru/Bangalore
₹20,000 - ₹30,000
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English