LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

LMCache

Supercharge Your LLM with the Fastest KV Cache Layer

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

2mo ago

Recent commits

Latest commits.

init storage manager after register kv caches (#2316)
83dfa16chunxiaozheng6mo ago
[Bugfix] Harden ZMQ proxy loop in `examples/disagg_prefill/disagg_proxy_server.py` (#2287)
d486410tunglinwood6mo ago
auto store remote to local pool (#2213)
6213f50lisiG96mo ago
[Core] Introduce NixlStorageBackend dynamic mode (#2024)
1102e56Tomer Shmilovich6mo ago
[refactor] use shapes and dtypes in RemoteMetadata (#2315)
a641ed5chunxiaozheng6mo ago

[Controller] Use dealer mode for worker->Controller zmq communication (#2330)

0f2e110maobaolong6mo ago

Remove v0 surviving code (#2319)

842b1ecmaobaolong6mo ago

Fix memory leak and circuit breaker in S3Connector batched_get (#2292)

2d80432yangw6mo ago

Top contributors

Builders behind this project.