(C) Alec Muffett's DropSafe blog.
Author Name: Alec Muffett
This story was originally published on allecmuffett.com. [1]
License: CC-BY-SA 3.0.[2]


A nanoGPT pipeline packed in a spreadsheet

2024-06-10 12:16:27+00:00

I recreated an entire GPT architecture in a spreadsheet.

It is a nanoGPT designed by @karpathy with about 85000 parameters, small enough to be packed into a spreadsheet file.



It is great for learning about how transformer works as it shows all the data and parameters going… pic.twitter.com/qC6hmpEp0h
[END]

[1] URL: https://alecmuffett.com/article/109915
[2] URL: https://creativecommons.org/licenses/by-sa/3.0/

DropSafe Blog via Magical.Fish Gopher News Feeds:
gopher://magical.fish/1/feeds/news/alecmuffett/

You are viewing proxied material from magical.fish. The copyright of proxied material belongs to its original authors. Any comments or complaints in relation to proxied material should be directed to the original authors of the content concerned. Please see the disclaimer for more details.