Rust

forge-llm

Rust-native AOT compiler for small LLMs. Turns GGUF weights into optimized self-contained binaries — CPU SIMD, Metal, WASM, no interpreter.