LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Python

LMCache

Supercharge Your LLM with the Fastest KV Cache Layer

PythonEmerging

Stars

—

Forks

—

Contributors

8

Last push

9mo ago

Recent commits

Latest commits.

Merge branch 'dev' of github.com:egretwAlker/LMCache into dev
b17a6faTianxiang XIA9mo ago
Remove the hardcode to turn off special tokens in SegmentTokenDatabase
9eea7dcTianxiang Xia9mo ago
[Misc] add dummy decorator when nvtx is not available (#1502)
3add942Jeff Wu9mo ago
Fix a small typo issue within the log of LocalCPUBackend (#1531)
24004b8maobaolong10mo ago
Fix a format issue of plugin_framework.rst (#1532)
dfa7cb9maobaolong10mo ago

[Doc] updated cache controller API document (#1527)

cadd4feziruiliu10mo ago

[DOC][Bugfix] fix cuda device export in doc (#1508)

ea73ab4Mengbing Wang10mo ago

Async KV loading (#1513)

87e6954Jiayi Yao10mo ago

Top contributors

Builders behind this project.