Skip to content

RAG & Search

Retrieval-augmented generation

RAG

AI looks up relevant information before answering you.

How it works

  1. AskYou ask a question.
  2. SearchIt searches a source.
  3. RetrieveIt finds the passage.
  4. AnswerIt answers using the passage.

Example

Your company connects an AI assistant to its HR handbook. When you ask about parental leave, it retrieves the relevant policy and uses it to answer.

Why it matters

It lets AI answer using information that wasn’t necessarily included in its original training.

You'll hear it

“We’re using RAG so the chatbot can answer questions about our internal documents.”

Can you control it?

Set by the team

The people building or running the AI choose this setup. An everyday user generally needs their help to change how this part works.

Common questions

What can RAG get wrong?
It may find outdated or irrelevant material, miss a useful document, or misunderstand what it reads.
Does RAG retrain the model?
No. Looking up information for a reply does not itself change the AI's underlying learning.
How can I judge a RAG answer?
Open the cited sources, confirm they support each important claim, and notice whether relevant documents appear to be missing.

AI chatbot

Still have questions?

Ask the AI chatbot about this term or another AI concept.

Up to 500 characters.

Ask LATHIC about AI. Relevant glossary entries may be included.

Your question, the glossary entries it matches, and a rotating pseudonymous identifier go to Microsoft Azure’s OpenAI service through Vercel AI Gateway to generate an answer. Zero retention and no training are required of the provider, and LATHIC does not save your question or answer. Privacy Notice