git-market/rasbt-LLMs-from-scratch

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-11 14:21:41 +08:00

History

Sebastian Raschka a5405c255d Cos-sin fix in Llama 2 bonus notebook (#381 )		2024-10-03 20:45:40 -05:00
..
tests	Improve rope settings for llama3 (#380 )	2024-10-03 08:29:54 -05:00
config.json	move access token to config.json	2024-09-23 08:56:16 -05:00
converting-gpt-to-llama2.ipynb	Cos-sin fix in Llama 2 bonus notebook (#381 )	2024-10-03 20:45:40 -05:00
previous_chapters.py	GPT to Llama (#368 )	2024-09-23 07:34:06 -05:00
README.md	GPT to Llama (#368 )	2024-09-23 07:34:06 -05:00
requirements-extra.txt	GPT to Llama (#368 )	2024-09-23 07:34:06 -05:00

README.md

Converting GPT to Llama

This folder contains code for converting the GPT implementation from chapter 4 and 5 to Meta AI's Llama architecture:

converting-gpt-to-llama2.ipynb: contains code to convert GPT to Llama 2 7B step by step and loads pretrained weights from Meta AI