Loreon
Labs
Platform
Docs
Home
Ecosystems
Python
gptest
jonahsamost/gptest
Python
Emerging
GitHub
Stars
—
Forks
—
Contributors
1
Last push
4mo ago
Recent commits
Latest commits.
working on graph break issue
dc15edf
jonah
4mo ago
loss still nan with rotary op
fdedfeb
jonah
4mo ago
added rotary bwd
3b200f1
jonah
4mo ago
add rotary benchmark
372af91
jonah
4mo ago
forward rotary emb works
d304e0a
jonah
4mo ago
starting rotary emb kernel
5fa5697
jonah
4mo ago
fp8 training needs single barrier in attn. need to write custom rotary fwd/bwd kernel as natural fusion boundary
a94622e
jonah
4mo ago
fp8 training with graph breaks
3f7e70d
jonah
4mo ago
Top contributors
Builders behind this project.
jonahsamost
42 commits
