LoreonLabsPlatform
DocsHome
  • Overview

Intelligence

  • Markets
  • Builders
  • Research
  • Ecosystems
  • Launchpads
  • Search
Ecosystems

C++

tensorrt_backend

The Triton backend for TensorRT.

C++Emerging
GitHub
Stars
—
Forks
—
Contributors
8
Last push
36mo ago

Recent commits

Latest commits.

  • Update tensorrt.cc
    b7cb1e7Chengyuan Li36mo ago
  • Add per-model memory usage reporting (#68)
    0f0c551GuanLuo37mo ago
  • Add more context to TensorRT error message (#67)
    a560e57Jacky38mo ago
  • Remove input buffer reset. Increase the cuda event set (#66)
    f5bf02bTanmay Verma40mo ago
  • Update cuda graph instantiation (#64) (#65)
    f4bf493Misha Chornyi41mo ago
Implement event timing using cudaEventElapsed (#60)
491e346Iman Tabrizian43mo ago
  • Add virtual destructor to the base class (#59)
    f46b478Kris Hung43mo ago
  • Support Triton BLOCKING policy to overlap host thread workload (#57)
    48b3685GuanLuo43mo ago

    • Top contributors

    Builders behind this project.

    tanmayv25
    21 commits
    GuanLuo
    7 commits
    krishung5
    7 commits
    Tabrizian
    4 commits
    the-david-oy
    3 commits
    nv-kmcgill53
    2 commits
    cyLi-Tiger
    1 commits
    CoderHam
    1 commits