GPU-accelerated, OpenAI-compatible LLM serving platform (vLLM + FastAPI)
Latest commits.
Builders behind this project.