Loreon
Labs
Platform
Docs
Home
Ecosystems
Other
ring-flash-attention
Ring attention implementation with flash attention
Other
Emerging
GitHub
Stars
—
Forks
—
Contributors
3
Last push
26mo ago
Recent commits
Latest commits.
Merge pull request #34 from Yuxin-CV/improve_update_out_and_lse
4fe1a51
Zilin Zhu
26mo ago
add descriptive comments to `_update_out_and_lse` to clarify its computational logic.
a920406
Yuxin-CV
26mo ago
Merge pull request #32 from Yuxin-CV/set_seed
67447e8
Zilin Zhu
26mo ago
improve readability and potential numerical stability of `out` and `lse` in `_update_out_and_lse` by refactoring their computational expressions.
b41b083
Yuxin-CV
26mo ago
fix random seed in test files for reproducibility
ad87e8d
Yuxin-CV
26mo ago
Merge pull request #30 from microhu/f_fix_exp_overflow
b39e427
Zilin Zhu
26mo ago
replace global var funciton by F.logsigmoid
e9fa83a
huwenping
26mo ago
fix exp overflow when updating lse
9b84a6a
huwenping
26mo ago
Top contributors
Builders behind this project.
zhuzilin
58 commits
reyoung
15 commits
Yuxin-CV
3 commits