LLM-Gateway

⚡ LLM Gateway is a zero-config local AI gateway. Run any GGUF model on your CPU with one command to instantly spin up an OpenAI-compatible API gateway. The ultimate lightweight LLM gateway—no Python, no Docker, no GPU required.