mlc-ai/web-llm

Why this repo matters

• •Enables running large language models directly in the browser.
• •Leverages WebGPU for efficient hardware acceleration.
• •Offers a way to deploy LLMs without server infrastructure.