LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Ecosystems
Launchpads

Python

vllm-metal

Community maintained hardware plugin for vLLM on Apple Silicon

PythonEmerging

Stars

—

Forks

—

Contributors

8

Last push

2d ago

Recent commits

Latest commits.

Bump vLLM to 0.23.0 (#443)
17855fcChao-Ju Chen3d ago
[GGUF] Add MLX-native Q8_0/Q4_0 runtime boundary (#442)
3f48c54Chao-Ju Chen4d ago
[CI] Fix two stale PP guard tests from #427 (#441)
ed144d2Ranran4d ago
[Distributed] Pipeline Paralell (#427)
e8e48a1Ranran5d ago
[kernel] Occupancy-gated split-KV decode (Flash-Decoding) (#437)
a019ef1Ranran5d ago

[LoRA] LoRA adapter support on Metal worker (#351)

30fb1f4Narain7d ago

[Installation] Add strict=False when parsing GitHub release JSON (#430)

b13dbe1renyuchen110d ago

Bump mlx-vlm and enable PaddleOCR-VL multi-image requests (#429)

6840ac5Bvicii10d ago

Top contributors

Builders behind this project.