SyntaxPilot
Courses/Generative AI Engineering/Lesson 70
Video coming soonThis lesson’s video is being made

Start with the notes below; the video appears here as soon as it is on YouTube.

Generative AI Engineering · Lesson 70 of 90

Quantisation

precision formats (FP32, FP16, BF16)INT8INT4quantisationpost-training quantisationGPTQAWQGGUF quant levels (Q4_K_M, Q8_0)quality vs sizeperplexity as a quality check

Detailed notes for this lesson are being written. They appear here together with the video.