Loreon
Labs
Platform
Docs
Home
Ecosystems
Python
Megatron-LM
Ongoing research training transformer models at scale
Python
Emerging
GitHub
Website
Stars
—
Forks
1
Contributors
8
Last push
6d ago
Recent commits
Latest commits.
hs embed mode, fixed layerscale, debugging spectral
3d4cf43
Alexander Hagele
1mo ago
submit scripts
b0f9708
Alexander Hagele
2mo ago
Merge remote-tracking branch 'refs/remotes/origin/main'
eaad941
Alexander Hagele
2mo ago
fixed layer scale
0280344
Alexander Hagele
2mo ago
fng and lr sched in submit:
3c9050c
Alexander Hagele
2mo ago
lr schedules and final norm no gain
1c89d7c
Alexander Hagele
2mo ago
forgot to ever add this debug script for heatmaps, just incase
1c16760
Alexander Hagele
2mo ago
add 1 to sub names, minor
7836b4e
Alexander Hagele
2mo ago
Top contributors
Builders behind this project.
ko3n1g
1.6K commits
jaredcasper
1K commits
lmcafee-nvidia
396 commits
shanmugamr1992
389 commits
shoeybi
339 commits
deepakn94
310 commits
ericharper
282 commits
mikolajblaz
242 commits
