A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM
Latest commits.
Builders behind this project.