Browsing: Llm Evaluation

There’s a category error that shows up in many LLM systems: We retrieve a few documents, put them in context, generate a fluent answer with links, and then we call the answer “grounded.”

Retrieval-augmented generation (RAG) answers questions using information retrievedfrom a set of documents. That document collection is called a corpus. A typical evaluationsends a well-written question to a tidy corpusand checks whether the retriever returns the correctpassage.