Topic: nvidia

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

FlashInfer: Kernel Library for LLM Serving

Linux GPU Configuration And Monitoring Tool

Optimized primitives for collective multi-GPU communication

CUDA Core Compute Libraries

Open Source Inference Research Platform Standard / 开源推理研究平台

Write Java. Run on GPUs. Fast.

Use your NVIDIA GPU's VRAM as swap space on Linux. Built for laptops with soldered memory and no upgrade path. If you have an RTX card sitting there with 8GB of VRAM and you're getting swapped to SSD, this puts that VRAM to work

A minimal, cross-compatible CPU/GPU telemetry monitor with accurate data directly from vendor APIs and beautiful ASCII visualization.

Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.

ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.

FlashInfer: Kernel Library for LLM Serving

Linux GPU Configuration And Monitoring Tool

Optimized primitives for collective multi-GPU communication

CUDA Core Compute Libraries

Open Source Inference Research Platform Standard / 开源推理研究平台