Linzhang Li

Fast, Flexible and Portable Structured Generation

Open ABI and FFI for Machine Learning Systems

A high-throughput and memory-efficient inference and serving engine for LLMs

SGLang is a fast serving framework for large language models and vision language models.