LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

FlexFlow

FlexFlow Serve: Low-Latency, High-Performance LLM Serving

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

27mo ago

Recent commits

Latest commits.

fix
e0a6e4fGabriele Oliaro27mo ago
run CI per commit only on inference branch
5bd7123Gabriele Oliaro27mo ago
fix
0479a64Gabriele Oliaro28mo ago
fix
8d82c91Gabriele Oliaro28mo ago
fix
c856680Gabriele Oliaro28mo ago
parametrize max_spec_tree_token_num

e03dec0Gabriele Oliaro28mo ago

add expansion config param in specinfer

ea31426Gabriele Oliaro28mo ago

Fix NCCL tear down issue, update docker pre-build cuda version list (#1318)

0d75c10Gabriele Oliaro28mo ago

Top contributors

Builders behind this project.