Capstone Lesson 39: Instruction Tuning by Supervised Fine-Tuning

A pretrained base model can extend a sequence but cannot follow an instruction. Supervised fine-tuning is the smallest change that fixes this: feed the model paired examples of an instruction and a desired response, and train the body to p...