Lesson 3.3

Evaluating retrieval

Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.

12mAdvanced5,356 students
Video thumbnail for Evaluating retrieval

Sign in to watch this lesson

Browsing is free. Create an account to play videos and track your progress.

Overview

Before blaming the model for a bad answer, check whether the right passage was ever retrieved. Recall at k tells you which half of the system to fix.

What this lesson covers

  • Build a query set with known correct passages
  • Measure recall and precision at k
  • Separate retrieval failures from generation failures

This lesson sits in Retrieval Quality, part of Retrieval-Augmented Generation from Scratch. It assumes what came before it and leads directly into the next lesson in the module.

In this lesson you will:

  • Build a query set with known correct passages
  • Measure recall and precision at k
  • Separate retrieval failures from generation failures
Evaluating retrieval — Skiply