mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 14:21:41 +08:00

History

Sebastian Raschka 72a073bbbf Remove leftover instances of self.tokenizer (#201 ) * Remove leftover instances of self.tokenizer * add endoftext token		2024-06-08 14:57:34 -05:00
..
01_main-chapter-code	Remove leftover instances of self.tokenizer (#201 )	2024-06-08 14:57:34 -05:00
02_bonus_bytepair-encoder	update formatting	2024-05-24 07:20:37 -05:00
03_bonus_embedding-vs-matmul	update formatting	2024-05-24 07:20:37 -05:00
04_bonus_dataloader-intuition	update formatting	2024-05-24 07:20:37 -05:00
README.md	add and update readme files	2024-02-05 06:51:58 -06:00

Chapter 2: Working with Text Data

01_main-chapter-code contains the main chapter code and exercise solutions
02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations
03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.