LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Ecosystems
Launchpads

Search

Python

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

PythonEmerging

Stars

—

Forks

—

Contributors

8

Last push

10d ago

Recent commits

Latest commits.

Preserve layout-changing clones (#44574)
2f27c9aMike G11d ago
[Bugfix] Fix `sequence_parallel_chunk_impl` custom op aliasing its input (#44130)
4765f0fVadim Gimpelson11d ago
[Cohere] fix RoutingMethodType (#44021)
a50e675Terrence Zhao11d ago
[Doc] Add Llama-3.2-3B-Instruct to batch-invariance tested models (#44435)
f6a708aDaoyuan Li11d ago
[ROCm][GPT-OSS] Fuse RoPE + static Q FP8 quant on fused RoPE+KV path (#42832)
4200f62akii9611d ago

[Core][Engine] allow DP ray placement groups to be set on specific nodes (#44669)

c73b0d0Walter Beller-Morales11d ago

Male Mergify comment less spammy (#44666)

e28e369Harry Mellor11d ago

[Bugfix] GPT-OSS instruction rendering (#44330)

703fb17yzong-rh11d ago

Top contributors

Builders behind this project.