git-market/rasbt-LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 02:11:40 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
main
rasbt-LLMs-from-scratch/ch05/05_bonus_hparam_tuning
History
Sebastian Raschka 7ca7c47e4a
Make quote style consistent (#891)
2025-10-21 19:42:33 -05:00
..
hparam_search.py Make quote style consistent (#891) 2025-10-21 19:42:33 -05:00
README.md Organized setup instructions (#115) 2024-04-10 22:09:46 -04:00
the-verdict.txt Add and link bonus material (#84) 2024-03-23 07:27:43 -05:00

README.md

Optimizing Hyperparameters for Pretraining

The hparam_search.py script, based on the extended training function in Appendix D: Adding Bells and Whistles to the Training Loop, is designed to find optimal hyperparameters via grid search.

Note

This script will take a long time to run. You may want to reduce the number of hyperparameter configurations explored in the HPARAM_GRID dictionary at the top.