git-market/rasbt-LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 14:21:41 +08:00
Code Issues Actions 11 Packages Projects Releases Wiki Activity
9d6da22ebb
rasbt-LLMs-from-scratch/ch04/01_main-chapter-code
History
Sebastian Raschka 9d6da22ebb Update pep8 (#78) 
* simplify requirements file

* style

* apply linter
2024-03-18 08:16:17 -05:00
..
ch04.ipynb add notes 2024-03-17 09:29:06 -05:00
exercise-solutions.ipynb add dropout for embedding layers 2024-03-04 07:05:06 -06:00
gpt.py Update pep8 (#78) 2024-03-18 08:16:17 -05:00
previous_chapters.py Update pep8 (#78) 2024-03-18 08:16:17 -05:00
README.md add and update readme files 2024-02-05 06:51:58 -06:00

README.md

Chapter 4: Implementing a GPT model from Scratch To Generate Text

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model
  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter