LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Builder

Iceber Gu

CNCF Ambassador🌟 & Golden Kubestronaut 🏆 . Focused on Cloud Runtime, Multi-Cluster and WASM ☁️ ☁️ ⛈️ @containerd reviewer & @clusterpedia-io founder

Followers

201

Public repos

130

Stars (recent)

22

Ecosystems

1

Projects

Repositories this builder owns.

Distributed KV cache scheduling & offloading libraries

Achieve state of the art inference performance with modern accelerators on Kubernetes

repo for CI and infrastructure required to maintain llm-d org member repos

llm-d Router: The intelligent entry point for inference requests

Connected narratives

AI Agents Consumer Crypto SocialFi Stablecoins Agent Commerce Onchain Apps

Related builders

Others building in the same ecosystem.

llm-d-modelservice

helm charts for deploying models with llm-d

C-ray — X-ray your containers. See beneath the runtime.

nvidia-container-toolkit

Build and run containers leveraging NVIDIA GPUs

llm-d-workload-variant-autoscaler

Variant optimization autoscaler for distributed inference workloads

Recent activity

Most recently pushed work.

Iceber/llm-d-kv-cache
pushed 3d ago
Iceber/llm-d
pushed 17d ago
Iceber/llm-d-infra
pushed 1mo ago
Iceber/llm-d-router
pushed 1mo ago