Loreon
Labs
Platform
Docs
Home
Ecosystems
Python
nanogpt-jax
Custom NanoGPT with JAX and Equiox
Python
Emerging
GitHub
Stars
2
Forks
—
Contributors
1
Last push
2mo ago
Recent commits
Latest commits.
add bf16 support
89a250f
adi-kmt
2mo ago
add muon, wsd and cheeckpointing
ac211b5
adi-kmt
2mo ago
Bug fixes + add slowrun config
50d4be4
adi-kmt
2mo ago
vo-rope MHLA
919005f
adi-kmt
10mo ago
add better config for interchanging parts
f8986ca
adi-kmt
10mo ago
write attention tests
9b5dd09
adi-kmt
10mo ago
implement GQA and MHLA
9742347
adi-kmt
10mo ago
more conservative model init, fix attention + rope bug in tensor format
47224e8
adi-kmt
11mo ago
Top contributors
Builders behind this project.
adi-kmt
18 commits
