Jan Hilgard

No description.

OpenAI-compatible server for Apple Silicon. Run LLMs and vision-language models (Llama, Qwen-VL, LLaVA) with continuous batching, MCP tool calling, and multimodal support. Native MLX backend, 400+ tok/s.

Real-time monitoring dashboard for local LLM inference servers (vllm-mlx + llama.cpp) — built with Next.js

Run LLMs with MLX