Lesson 4.1
Streaming responses to the browser
A streamed answer feels immediate even when total latency is unchanged. Streaming through your own server also keeps your API key off the client.
8mIntermediate14,113 students
Sign in to watch this lesson
Browsing is free. Create an account to play videos and track your progress.
Overview
A streamed answer feels immediate even when total latency is unchanged. Streaming through your own server also keeps your API key off the client.
What this lesson covers
- Stream tokens from the server to the browser
- Render partial output without layout thrash
- Handle cancellation and mid-stream errors
This lesson sits in Shipping to Production, part of Building AI Apps with LLMs. It assumes what came before it and leads directly into the next lesson in the module.
In this lesson you will:
- Stream tokens from the server to the browser
- Render partial output without layout thrash
- Handle cancellation and mid-stream errors