Detailed notes for this lesson are being written. They appear here together with the video.
Video coming soonThis lesson’s video is being made
Start with the notes below; the video appears here as soon as it is on YouTube.
Generative AI Engineering · Lesson 75 of 90
Preference tuning
RLHFreward modelpreference pairs (chosen vs rejected)PPO (overview)DPOKTO and ORPO (overview)alignment taxevaluating a preference-tuned model