LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Ecosystems
Launchpads

Search

Other

sglang

SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

5mo ago

Recent commits

Latest commits.

Update README.md (#358)
c93293cIkko Eltociear Ashimine27mo ago
Time cost utils (#355)
62b3812Liangsheng Yin27mo ago
Fix typos in infer_batch.py (#354)
550a4f7Tom Dörr27mo ago
Add timeout to get_meta_info (#346)
ff99c38SimoneRaponi27mo ago
Eliminate 2 gpu ops during sampling when logit_bias is zero (#338)
c9de3e1Qubitium27mo ago

Revert "Eliminate 2 gpu ops during sampling when logit_bias is zero" (#345)

ed27a6bLiangsheng Yin27mo ago

Eliminate 2 gpu ops during sampling when logit_bias is zero (#343)

463c663Liangsheng Yin27mo ago

fix gemma import error

b089063Ying Sheng27mo ago

Top contributors

Builders behind this project.