MathInf https://mathinf.eu/
Thomas Viehmann
Principal Research Engineer at @Lightning-AI Mathematics and Inference at @MathInf I do a lot of @PyTorch work
800
51
18
1
Projects
Repositories this builder owns.
dynamo
A Datacenter Scale Distributed Inference Serving Framework
smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
bitsandbytes
8-bit CUDA functions for PyTorch
sphinx-contrib-fulltoc
Extension for Sphinx to make the sidebar show a full table of contents instead of just the local headings
Connected narratives
Related builders
Others building in the same ecosystem.