LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Shell

llm-d

Achieve state of the art inference performance with modern accelerators on Kubernetes

ShellEmerging

Stars

—

Forks

—

Contributors

8

Last push

2mo ago

Recent commits

Latest commits.

Update ms-inference-scheduling/values_tpu_v7.yaml to use RunAI model streamer
7fb5c72Alexis MacAskill2mo ago
skip latest tag for release candidates (#1034)
e2f163dDiego Castan2mo ago
Updated maturity testing level on all guides (#1094)
3455fddmaugustosilva2mo ago
Fix image on pd user guide (#1086)
d5241a3Edwin Hernandez2mo ago
Fix formatting of automated test status in README (#1087)
ac5556fSean Horgan2mo ago

Revise maturity status and TPU VM type details (#1085)

31f85dcSean Horgan2mo ago

fix block-size alignment (#1084)

9f54ac8Maroon Ayoub2mo ago

fix concurrency group to sha not PR (#1073)

cd05677Greg Pereira2mo ago

Top contributors

Builders behind this project.

Gregory-Pereira

robertgshaw2-redhat