Lesson 1.2
Temperature and sampling
Sampling parameters decide how the next token is picked. Low temperature for extraction and classification, higher for anything that should feel varied.
8mIntermediate25,017 students
Sign in to watch this lesson
Browsing is free. Create an account to play videos and track your progress.
Overview
Sampling parameters decide how the next token is picked. Low temperature for extraction and classification, higher for anything that should feel varied.
What this lesson covers
- Trade determinism against variety with temperature
- Know what top-p changes and when to touch it
- Pick settings per task rather than globally
This lesson sits in LLM Fundamentals, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Trade determinism against variety with temperature
- Know what top-p changes and when to touch it
- Pick settings per task rather than globally