Other
llm-d enables high-performance distributed LLM inference on Kubernetes
Latest commits.
Builders behind this project.