Nehanth/swarmllm

Trend Velocity Score: 0.00
Opportunity Score: 10.00
Confidence Score: 10.00
First Seen: 4 weeks ago

Name: GitHub Repos Radar Database
Creator: MaximoSEO
License: https://opensource.org/licenses/MIT

Skip(New discovery — enrichment pending)

Why this repo matters

Runs LLMs across multiple devices in a browser, distributing model slices.
Leverages WebGPU and WebRTC for distributed inference without central servers.
Achieves competitive decode speeds by distributing computation and optimizing kernels.

Get up and running with Kimi-K2.6, GLM-5.2, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

LLM inference in C/C++

LLM inference in C/C++