mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2026-04-11 02:11:40 +08:00
|
|
||
|---|---|---|
| .. | ||
| create-preference-data-ollama.ipynb | ||
| dpo-from-scratch.ipynb | ||
| instruction-data-with-preference.json | ||
| previous_chapters.py | ||
| README.md | ||
Chapter 7: Finetuning to Follow Instructions
-
create-preference-data-ollama.ipynb: A notebook that creates a synthetic dataset for preference finetuning dataset using Llama 3.1 and Ollama
-
dpo-from-scratch.ipynb: This notebook implements Direct Preference Optimization (DPO) for LLM alignment