LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

flash-attention

Fast and memory-efficient exact attention

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

32mo ago

Recent commits

Latest commits.

[LayerNorm] Add postnorm residual + LayerNorm/RMSNorm in Triton
0177164Tri Dao32mo ago
[LayerNorm] Implement residual + LayerNorm/RMSNorm in Triton
79bd1a2Tri Dao32mo ago
Fix typo in RotaryEmbedding forward output type (#666)
3566596Antony Frolov32mo ago
Bump to v2.3.3
83aef84Tri Dao32mo ago
[CrossEntropy] Fix triton cross_entropy_loss IMA for >=2B elements
c79de85Tri Dao32mo ago

Clarify inference README is a placeholder

02ac572Tri Dao33mo ago

7f31e7cTri Dao33mo ago

Change constexpr int to constexpr static int

5a83425Tri Dao33mo ago

Top contributors

Builders behind this project.