@RedHatOfficial
Wen Zhou
@zdtsw · Sweden
70
248
—
1
Projects
Repositories this builder owns.
llm-d-workload-variant-autoscaler
Variant optimization autoscaler for distributed inference workloads
llm-d-router
Inference scheduler for llm-d
llm-d
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
llm-d-latency-predictor
Latency prediction service for ML-model based scoring with llm-d-inference-scheduler
Connected narratives
Related builders
Others building in the same ecosystem.
