Loreon
Labs
Platform
Docs
Home
Ecosystems
Python
modded-nanogpt
NanoGPT (124M) in 90 seconds
Python
Emerging
GitHub
Stars
—
Forks
—
Contributors
8
Last push
2mo ago
Recent commits
Latest commits.
jepa: compare JEPA encoder vs LM mid-layer features (head-to-head, 12L/768D)
bfb1a13
Broyojo
2mo ago
jepa: feature-quality comparison script (JEPA vs LM mid-layer)
eb00b0e
Broyojo
2mo ago
jepa: plain GPT (next-token CE) baseline matching large JEPA arch
c5b87a6
Broyojo
2mo ago
jepa: ablation results — viz + comparison script
4cee6e8
Broyojo
2mo ago
jepa: visualize.py — semantic attention analyzer + 500M-run figures
feecf29
Broyojo
2mo ago
jepa: per-config checkpoint paths + ablations chain script
2b45186
Broyojo
2mo ago
jepa: add NoPE ablation (use_rope=False)
a389f75
Broyojo
2mo ago
jepa: add EMA target encoder + prediction-lag ablation knobs
0ca841a
Broyojo
2mo ago
Top contributors
Builders behind this project.
KellerJordan
1.5K commits
ClassicLarry
141 commits
YouJiacheng
27 commits
Broyojo
15 commits
varunneal
11 commits
leloykun
10 commits
kiankyars
8 commits
chrisjmccormick
6 commits