A library of transformer kernels written in Python PyTorch and Triton plus small scale transformer scaling law experiments.
Latest commits.
Builders behind this project.
