SemiAnalysisAI/InferenceX

Why this repo matters

• •Provides an open-source platform for researching and standardizing LLM inference.
• •Benchmarks inference performance across various hardware and software stacks.
• •Supports multiple popular LLM serving frameworks and GPUs.