Lesson 3.3
Evaluating retrieval
Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.
12mAdvanced5,356 students

Sign in to watch this lesson
Browsing is free. Create an account to play videos and track your progress.
Overview
Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.
What this lesson covers
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures
This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Build a query set with known correct passages
- Measure recall and precision at k
- Separate retrieval failures from generation failures