LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

Other

llm-d-inference-scheduler

Inference scheduler for llm-d

OtherEmerging
GitHubWebsite
Stars
—
Forks
—
Contributors
8
Last push
2d ago

Recent commits

Latest commits.

  • Fix outdate debug info (#216)
    881aaa0杨朱 · Kiki12mo ago
  • Fixed some typos (#212)
    4d9d8cfYuan Tang12mo ago
  • updated README (#204)
    4e7fe4eNir Rozenbaum12mo ago
  • Add IDE files to .gitignore (#213)
    58a52d9Yuan Tang12mo ago
  • fix: allow prefill when prefixState is unavailable (#211)
    7cc452aKfir Toledo12mo ago
feat: Add factory functions for all plugins (#208)
9063d2eShmuel Kallner12mo ago
  • fix: share prefix scorer between PD profiles
    7a8dfa7Kfir Toledo12mo ago
  • refactor: romve prefix aware scorer in favor of unified GIE prefix scorer
    bb7705fKfir Toledo12mo ago

    • Top contributors

    Builders behind this project.

    shaneutt
    53 commits
    vMaroon
    31 commits
    elevran
    26 commits
    shmuelk
    19 commits
    mayabar
    18 commits
    clubanderson
    16 commits
    kfirtoledo
    11 commits
    nirrozenbaum
    9 commits