LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

LMCache

Supercharge Your LLM with the Fastest KV Cache Layer

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

4mo ago

Recent commits

Latest commits.

[Observability]: Fix vllm cached and prompt tokens (#2576)
dcd2e4fSamuel Shen4mo ago
Add bundle of bypass backend internal apis (#2619)
9d00b01maobaolong4mo ago
Add hot cache switch internal api (#2620)
e10c542maobaolong4mo ago
[Core] Add enum for EngineType (#2555)
e0a7be6Martin Hickey4mo ago
[UT] Add UT for utils.py (#2615)
7abd114maobaolong4mo ago

Check failed put task count and record metrics (#2439)

379b6bemaobaolong4mo ago

[DOC] Complete the internal_api_server api document (#2617)

4291495maobaolong4mo ago

[DOC] Introduce LMCache frontend document (#2618)

c56e6famaobaolong4mo ago

Top contributors

Builders behind this project.