LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

OtherEmerging

Stars

—

Forks

—

Contributors

8

Last push

35mo ago

Recent commits

Latest commits.

Adding trust_remote_code support (#203)
98b6129Mahesh Sinha36mo ago
Improve unit tests (#209)
ce80314Michael Wyatt36mo ago
Always enable load balancing (#205)
9fa7b3cTosinSeg36mo ago
Generalize meta tensor pipeline (#199)
60a85dcMichael Wyatt36mo ago
add llama and update readme counts (#206)
5f60390Jeff Rasley36mo ago

Add Non-persistent deployment type (#197)

dac178eTosinSeg36mo ago

Refactored all grpc methods in method_table (#202)

dc5ab44TosinSeg37mo ago

Refactored all grpc methods in method_table (#202)

7865ae9TosinSeg37mo ago

Top contributors

Builders behind this project.

microsoftopensource