Capstone 07 — End-to-End Fine-Tuning Pipeline (Data to SFT to DPO to Serve)

An 8B model trained on your own data, DPO-aligned on your own preferences, quantized, speculative-decoded, and served at measurable $/1M tokens. The 2026 open stack is Axolotl v0.8, TRL 0.15, Unsloth for iteration, GPTQ/AWQ/GGUF for quanti...