Large Language Model and Retrieval-Augmented Generation Engineer

Indium Software India
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 5 yearsMin. 5 years

Job Description

Data Scientist

Job Description – LLM / RAG Engineer

We are looking for a skilled LLM / RAG Engineer to design, build, and operate production-grade AI systems using large language models. The ideal candidate will have strong hands-on experience with RAG architectures, data preparation, evaluation, and LLMOps, along with the ability to deliver reliable and user-friendly conversational applications.

Key Responsibilities:

LLM Fundamentals

• Understand how LLMs generate text and common failure modes such as hallucinations and context limitations • Design effective prompts including system prompts, grounding techniques, and few-shot examples • Differentiate between embedding and generation models • Decide when to use RAG vs. fine-tuning

RAG Architecture (Critical)

• Design and implement semantic and structure-aware chunking strategies • Build vector and hybrid search pipelines • Implement query rewriting, top-k selection, and re-ranking • Apply metadata filtering and enable citations for grounded responses

Unstructured Data Processing

• Extract text from PDFs, DOCX, HTML, and OCR sources • Perform data cleaning, deduplication, and normalization • Prepare chunk-ready datasets with rich metadata

Structured Data & Analytics

• Strong SQL proficiency • Implement text-to-SQL workflows with guardrails • Enable schema-aware retrieval and analytical querying • Combine computed results with clear LLM-generated explanations

Evaluation & Monitoring

• Measure retrieval relevance and answer groundedness • Build offline evaluation datasets with human review • Monitor latency, cost, and response quality in production

LLMOps

• Manage prompt and model versioning • Support rollbacks and safe deployments • Track cost, performance, and system reliability

Frontend & Conversational UX

• Design conversational experiences with follow-up handling • Implement citations and confidence indicators in responses • Build lightweight frontends using Flask • Capture and utilize user feedback for continuous improvement

Required Skills

• Strong understanding of LLM and RAG systems • Experience with vector databases and retrieval pipelines • Solid SQL and data handling expertise • Hands-on experience with Flask-based applications • Strong problem-solving, communication, and system design skills

Experience Level

Senior Level

Job role

Work location
Work locationBangalore North, India
Department
DepartmentData Science & Analytics
Role / Category
Role / CategoryData Science & Machine Learning
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 5 years

About company

Name
NameIndium Software India
Job posted by Indium Software India

Similar jobs you can apply for

Software / Web Developer
BNV Software

Software / Web Developer Intern

BNV Software
Domlur, Bengaluru/Bangalore
₹12,000 - ₹18,000
Work from Office
Full Time
Freshers only
Good (Intermediate / Advanced) English
Minchu Productions

App Developer

Minchu Productions
Jaya Nagar, Bengaluru/Bangalore
₹25,000 - ₹25,000
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English
Jai Finance India Limited

Quality Assurance Officer

Jai Finance India Limited
BTM Layout, Bengaluru/Bangalore
₹25,000 - ₹30,000
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English
Ace Carbo Nitriders

Quality Engineer

Ace Carbo Nitriders
Peenya, Bengaluru/Bangalore
₹18,000 - ₹30,000
Work from Office
Full Time
Any experience
Basic English
360 Bytes Tech Venture Private Limited

Package Consultant – SAP HANA SCM PM

360 Bytes Tech Venture Private Limited
Bengaluru/Bangalore
₹1,00,000 - ₹1,15,000
Work from Office
Full Time
Min. 10 years
Good (Intermediate / Advanced) English
Digitory Solutions

DevOps Engineer

Digitory Solutions
Basavanagudi, Bengaluru/Bangalore
₹20,000 - ₹50,000
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English

You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.

The candidate should have sound communication skills and sound communication skills for this job.

Both Male and Female candidates can apply for this job.

No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.

No work-related deposit needs to be made during your employment with the company.

Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!