Other

modelexpress

Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and improve overall performance.