LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

Python

sglang

SGLang is a fast serving framework for large language models and vision language models.

PythonEmerging
GitHubWebsite
Stars
3
Forks
—
Contributors
8
Last push
5mo ago

Recent commits

Latest commits.

  • fix: resolve arm build issue (#8052)
    4a88379Yineng Zhang11mo ago
  • Fix the input tools format and history tool_calls in OpenAI API (#6556)
    f1f1d1djiawei11mo ago
  • fix: remove redundant rotary embedding cache recomputation in MiniCPM (#8022)
    9120e83Xinyuan Tong11mo ago
  • feat: update multimodal data handling in engine entrypoint (#8002)
    6e923dbXinyuan Tong11mo ago
  • [feat]Support fusion kernel for constructing quant input and scale factor for fp8_blockwise_scaled_grouped_mm (#8023)
    c268c11Qi Yuhang11mo ago
  • Update CODEOWNERS (#8044)
    e6d5988Chang Su11mo ago
  • fix: modality length mismatch with image_data (#7887)
    9b560c3杨睿11mo ago
  • Setup workflow for releasing mi300x and mi350x dockers. (#8035)
    5dc5866Sai Enduri11mo ago
  • Top contributors

    Builders behind this project.

    merrymercy
    745 commits
    zhyncs
    597 commits
    fzyzcjy
    207 commits
    Ying1123
    184 commits
    hnyls2002
    168 commits
    ispobock
    119 commits
    ByronHsu
    113 commits
    BBuf
    91 commits