Context is not memory
Untangle learned parameters, the supplied prompt, temporary caches, and retrieved evidence. These are different mechanisms with different limits.
By the endChoose an appropriate response when useful information does not fit in the current context.
Start path: Parameters: the numbers learning changes →6 lessons · 36 min total
Mark lessons as read to save your place on this browser.
- 16 MIN READING · Not read yet
Parameters: the numbers learning changes
Identify the persistent learned numbers.
Read the lesson → - 26 MIN READING · Not read yet
Context windows: what is available right now
Identify the finite sequence available to a request.
Read the lesson → - 36 MIN READING · Not read yet
In-context learning: adapting without weight updates
See why examples can guide behavior without updates.
Read the lesson → - 46 MIN READING · Not read yet
The KV cache: reusing the past
Understand reuse of intermediate attention computations.
Read the lesson → - 56 MIN READING · Not read yet
Context management: choosing what stays in view
Choose what to preserve, summarize, or retrieve.
Read the lesson → - 66 MIN READING · Not read yet
Retrieval: giving the model evidence
Bring selected external evidence into a new request.
Read the lesson →