LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

Other

rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

OtherEmerging
GitHub
Stars
—
Forks
—
Contributors
8
Last push
9mo ago

Recent commits

Latest commits.

  • feat - add main status logging in get-CI-result.sh & - remove on push
    cde7795luoxi9mo ago
  • fix - add fi in merge-request-trigger.yml
    1f4534dluoxi9mo ago
  • chore: support paged attn for spec decode
    19a9dcfhuzetao.hzt9mo ago
  • chore: rm max generate batch size limit in speculative decoding
    52a6906huzetao.hzt9mo ago
  • fix - add github.event.pull_request.merged check to avoid triggering merge on closed PRs & remove echo & remove test.txt and support echo commit id, sleep 120s
    3564916luoxi9mo ago
update - update benchmarkd docs
facd634baowending.bwd9mo ago
  • fix: add test data into gitignore
    ae9cfc8wht219mo ago
  • test: add remote debug helper
    7a20d6awangyin9mo ago
  • Top contributors

    Builders behind this project.

    Proton02
    43 commits
    feifei14119
    36 commits
    wht21
    20 commits
    xinfei-shi
    13 commits
    draganmladjenovic
    11 commits
    valarLip
    10 commits
    Reyfone
    5 commits
    netaddi
    5 commits