LoreonLabsPlatform

Overview

Intelligence

Markets
Builders
Research
Narratives
Ecosystems
Launchpads

Discover

Search
Sources

Other

triton-inference-server

The Triton Inference Server provides a cloud inferencing solution optimized for NVIDIA GPUs.

OtherEmerging

Stars

1

Forks

—

Contributors

8

Last push

73mo ago

Recent commits

Latest commits.

Add L0_perf_kaldi Benchmark (#1542)
880db08Hemant Jain73mo ago
Remove explicit batch-size from response (#1694)
81a10e1deadeyegoodwin73mo ago
Fix QA tests to correctly specify client verbosity (#1696)
e779070Tanmay Verma73mo ago
No longer need to force CPU ops for add sub for int8, int16, int32 (#1692)
7602003Hemant Jain73mo ago
Create backend_utils.cc for common backend utilities (#1695)
0c5561edeadeyegoodwin73mo ago

Allow response callback to communicate additional semantics via flags (#1691)

ca6dd68deadeyegoodwin73mo ago

Include only tritonserver.h in server container (#1690)

fba43c3deadeyegoodwin73mo ago

Add some future proofing to request release callback (#1689)

9457937deadeyegoodwin73mo ago

Top contributors

Builders behind this project.