Janus - Go binary for local GGUF models via Vulkan
Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia
Janus is a single Go binary that runs .gguf models locally on your GPU or CPU and exposes an OpenAI-compatible API plus a built-in web UI. No Python, Docker, or Ollama required. It supports Vulkan for AMD, Intel, and NVIDIA GPUs, with CPU fallback. The web UI includes Assistant, Chat, Kernel, Config, Memory, and Skills tabs, and built-in tools for file operations, commands, math, document conversion, and OCR. Hot-swap models without restarting. Use it from the command line, scripts, Cursor, Cline, or any OpenAI client. Janus keeps everything local and gives you full control.
The model decides what to do; Go runs inference, routes requests, executes tools, and keeps everything local.