git-market/rasbt-LLMs-from-scratch

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 14:21:41 +08:00

History

Daniel Kleine 2ee3df622e nbviewer links / typo (#346 ) * fixed typo * removed remaining nbviewer links * Update mha-implementations.ipynb --------- Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>		2024-09-07 07:27:28 +02:00
..
01_main-chapter-code	Test code in pytorch 2.4 (#285 )	2024-07-24 21:53:41 -05:00
02_bonus_efficient-multihead-attention	nbviewer links / typo (#346 )	2024-09-07 07:27:28 +02:00
03_understanding-buffers	Update README.md	2024-07-30 06:55:41 -05:00
README.md	Understanding PyTorch Buffers (#288 )	2024-07-26 08:45:36 -05:00

README.md

Chapter 3: Coding Attention Mechanisms

Main Chapter Code

01_main-chapter-code contains the main chapter code.

Bonus Materials

02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention
03_understanding-buffers explains the idea behind PyTorch buffers, which are used to implement the causal attention mechanism in chapter 3