ggml-org/llama.cpp

ollama/ollama

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

open-webui/open-webui

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

ggerganov/llama.cpp

LLM inference in C/C++

deepseek-ai/DeepSeek-V3

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs