Open source local inference engine. It runs models on the hardware you already have, whether that's a Mac, an NVIDIA or AMD GPU, or just a CPU. Plug it into Pi, OpenCode, Hermes, OpenClaw, Codex, Claude Code, Oh My Pi, and Cline.
Why this repo matters
•Offers a fully private, offline agent with local models, eliminating data privacy concerns.
•Simplifies AI agent setup by working out-of-the-box on any hardware without complex configuration.
•Extensible with skills for common applications like Excel, PDFs, and Chrome, enhancing productivity.