git-market/rasbt-LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 14:21:41 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
e24fd98cdf
rasbt-LLMs-from-scratch/ch02
History
rasbt e24fd98cdf
distinguish better between main chapter code and bonus materials
2024-06-11 21:07:42 -05:00
..
01_main-chapter-code add allowed_special={"<|endoftext|>"} 2024-06-09 06:04:02 -05:00
02_bonus_bytepair-encoder update formatting 2024-05-24 07:20:37 -05:00
03_bonus_embedding-vs-matmul update formatting 2024-05-24 07:20:37 -05:00
04_bonus_dataloader-intuition update formatting 2024-05-24 07:20:37 -05:00
README.md distinguish better between main chapter code and bonus materials 2024-06-11 21:07:42 -05:00

README.md

Chapter 2: Working with Text Data

Main Chapter Code

Bonus Materials

  • 02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations

  • 03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.