sgl-project/sglang

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui/open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

ggerganov/llama.cpp

LLM inference in C/C++

ggml-org/llama.cpp

LLM inference in C/C++

deepseek-ai/DeepSeek-V3