Loreon
Labs
Platform
Docs
Home
Ecosystems
Python
nanochat
The best ChatGPT that $100 can buy.
Python
Emerging
GitHub
Stars
—
Forks
—
Contributors
8
Last push
3mo ago
Recent commits
Latest commits.
fix scaling laws scripts after the bigram embeddings were removed
5019acc
Andrej Karpathy
3mo ago
submit new time to GPT-2 leaderboard entry: 99 minutes
1b1cc3c
Andrej Karpathy
3mo ago
Autoresearch round 2: smear, backout, and hyperparameter tuning
a825e63
Andrej Karpathy
3mo ago
new leaderboard entry coming from improvements of autoresearch round 1, time to gpt-2 from 2.02 hours to 1.80 hours
f068604
Andrej Karpathy
3mo ago
All of these improvements were developed by Claude running autonomously over ~2 days using autoresearch. I didn't touch anything - incredible. All tuning was done on d12 but generalized easily to larger models (e.g. d24 in particular). This means we will also get a new "Time to GPT-2" Leaderboard entry, which I will push separately.
6ed7d1d
Andrej Karpathy
3mo ago
delete autocast, an unnecessary thorn in my side, manage dtypes directly
1076f97
Andrej Karpathy
4mo ago
Ensure that inputs and targets are contiguous (#569)
752abc8
Sofie Van Landeghem
4mo ago
Document new Leaderboard entry congrats @ddudek for pointing out ClimbMix, time to GPT-2 is now 2.01 hours, down from 2.76 previously
4b40774
Andrej Karpathy
4mo ago
Top contributors
Builders behind this project.
karpathy
249 commits
svlandeg
27 commits
lukestanley
8 commits
ericsilberstein
6 commits
dipeshbabu
4 commits
Kripner
3 commits
burtenshaw
3 commits
Kurt232
3 commits