This lesson is being remade with real tools (a real database, the real AI model). The new video and its detailed notes appear here as soon as they are ready.
Video coming soonThis lesson’s video is being made
Start with the notes below; the video appears here as soon as it is on YouTube.
Generative AI Engineering · Lesson 7 of 90
Multi-turn chat and the context window
stateless APIconversation historycontext windowcontext lengthinput plus output budgettoken budgettruncationsliding window historysummarising old turnsassistant prefillwhy long chats get slow and expensive