(C) Alec Muffett's DropSafe blog.
Author Name: Alec Muffett
This story was originally published on allecmuffett.com. [1]
License: CC-BY-SA 3.0.[2]


naklecha / llama3-from-scratch: llama3 implementation one matrix multiplication at a time

2024-05-20 15:16:18+00:00

At some point I am going to have to clone this and run it, aren’t I?

> in this file, i implemented llama3 from scratch, one tensor and matrix multiplication at a time.

also, im going to load tensors directly from the model file that meta provided for llama3, you need to download the weights before running this file. here is the offical link to download the weights: https://llama.meta.com/llama-downloads/
[END]

[1] URL: https://alecmuffett.com/article/109840
[2] URL: https://creativecommons.org/licenses/by-sa/3.0/

DropSafe Blog via Magical.Fish Gopher News Feeds:
gopher://magical.fish/1/feeds/news/alecmuffett/

You are viewing proxied material from magical.fish. The copyright of proxied material belongs to its original authors. Any comments or complaints in relation to proxied material should be directed to the original authors of the content concerned. Please see the disclaimer for more details.