Other
A high-throughput and memory-efficient inference and serving engine for LLMs
Latest commits.
No recent commits available.
Builders behind this project.
No contributor data available.