LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

llm-d-inference-sim

A light weight vLLM simulator, for mocking out replicas.

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

7mo ago

Recent commits

Latest commits.

docs: add P/D disaggregation example in manifests/disaggregation (#253)
5c58b12CYJiang7mo ago
update PD support to be compatible with nixlv2 (#258)
c5bfb72Maya Barnea7mo ago
Update logic of response generation in case of dataset usage (#257)
719a895Maya Barnea7mo ago
Added cache-config-info metric (#256)
ff4c9eaIra Rosen7mo ago
Sleep mode (#252)
b3f93d6Ira Rosen7mo ago

Support vllm:max_num_generation_tokens metrics (#250)

e1e27eaMaya Barnea8mo ago

add metrics tests for latency metrics with remote prefill (#248)

a9dd5c5Maya Barnea8mo ago

Fixed dataset test (#246)

c7fef65Ira Rosen8mo ago

Top contributors

Builders behind this project.