This lesson is being remade with real tools (a real database, the real AI model). The new video and its detailed notes appear here as soon as they are ready.
Generative AI Engineering · Lesson 10 of 90 · 13 min
Async, concurrency and batch calls
synchronous vs asynchronous codeasync and awaitasyncioevent loopconcurrencyasyncio.gathersemaphore for concurrency limitsthroughput vs latencybatch APIbatch jobs and polling