Byron Hsu

SGLang is a fast serving framework for large language models and vision language models.

Bindings for RDMA ibverbs through rdma-core

PyTorch native quantization and sparsity for training and inference

FlashInfer: Kernel Library for LLM Serving