Quantized Attention achieves speedup of 2-3x and 3-5x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
Latest commits.
No recent commits available.
Builders behind this project.
No contributor data available.