Repositories list

• kvpress

  Public
  LLM KV cache compression made easy

  pythontransformersinference+ 6

  pythontransformersinferencepytorchkv-cachelarge-language-modelsllmlong-contextkv-cache-compression

  Python

  •

  Apache License 2.0

  •167167 forks•1.2k1.2k stars•22 issues•44 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cccl

  Public
  CUDA Core Compute Libraries

  cpphpcgpu+ 16

  cpphpcgpumodern-cppparallel-computingcudanvidiagpu-accelerationcuda-kernelsgpu-computing+ 9

  C++

  •

  Other

  •456456 forks•2.5k2.5k stars•1.7k1.7k issues•285285 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cuda-quantum

  Public
  C++ and Python support for the CUDA Quantum programming model for heterogeneous quantum-classical workflows

  pythoncppquantum+ 6

  pythoncppquantumquantum-computinghacktoberfestquantum-programming-languagequantum-algorithmsquantum-machine-learningunitaryhack

  C++

  •

  Apache License 2.0

  •434434 forks•1.1k1.1k stars•347347 issues•151151 pull requests•Updated Aug 6, 2026Aug 6, 2026

• NemoClaw

  Public

  NVIDIA/NemoClaw’s past year of commit activity
  Run agents like Hermes, LangChain Deep Agents, and OpenClaw more securely inside NVIDIA OpenShell with managed inference

  typescriptnvidiasandboxing+ 4

  typescriptnvidiasandboxinghermesai-agentsopenclawopenshell

  TypeScript

  •

  Apache License 2.0

  •3k3k forks•22k22k stars•271271 issues•7878 pull requests•Updated Aug 6, 2026Aug 6, 2026

• infra-controller

  Public
  NVIDIA Infra Controller - Hardware Lifecycle Management and multitenant networking

  Rust

  •

  Apache License 2.0

  •168168 forks•246246 stars•720720 issues•9595 pull requests•Updated Aug 6, 2026Aug 6, 2026

• NeMo-Relay

  Public
  Multi-language agent runtime and library for execution scope management, lifecycle events, and middleware on tool and LLM calls.

  securitymiddlewareai+ 16

  securitymiddlewareairuntimeoptimizationnvidiaagentsobservabilitycodexotel+ 9

  Rust

  •

  Apache License 2.0

  •5252 forks•110110 stars•1010 issues•2929 pull requests•Updated Aug 6, 2026Aug 6, 2026

• aicr

  Public

  NVIDIA/aicr’s past year of commit activity
  Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes

  configkubernetesmanifest+ 5

  configkubernetesmanifestairuntimegpuhelmargocd

  Go

  •

  Apache License 2.0

  •7979 forks•376376 stars•9797 issues•1111 pull requests•Updated Aug 6, 2026Aug 6, 2026

• JAX-Toolbox

  Public
  JAX-Toolbox

  Python

  •

  Apache License 2.0

  •7979 forks•424424 stars•55 issues•3838 pull requests•Updated Aug 6, 2026Aug 6, 2026

• TensorRT-LLM

  Public

  NVIDIA/TensorRT-LLM’s past year of commit activity
  TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inferen…

  cudapytorchmoe+ 2

  cudapytorchmoeblackwellllm-serving

  Python

  •

  Other

  •2.6k2.6k forks•14k14k stars•613613 issues•998998 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cudf-spark-jni

  Public

  NVIDIA/cudf-spark-jni’s past year of commit activity
  RAPIDS Accelerator JNI For Apache Spark

  Cuda

  •

  Apache License 2.0

  •8989 forks•6363 stars•9696 issues•2121 pull requests•Updated Aug 6, 2026Aug 6, 2026

• raft

  Public
  RAFT contains fundamental widely-used algorithms and primitives for machine learning and information retrieval. The algorithms are CUDA-accelerated and form bui…

  machine-learninginformation-retrievalstatistics+ 17

  machine-learninginformation-retrievalstatisticsclusteringgpudistancelinear-algebracudaprimitivessparse+ 10

  Cuda

  •

  Apache License 2.0

  •243243 forks•1k1k stars•428428 issues•1616 pull requests•Updated Aug 6, 2026Aug 6, 2026

• Model-Optimizer

  Public

  NVIDIA/Model-Optimizer’s past year of commit activity
  A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It comp…

  Python

  •

  Apache License 2.0

  •535535 forks•3.4k3.4k stars•8282 issues•253253 pull requests•Updated Aug 6, 2026Aug 6, 2026

• NVFlare

  Public

  NVIDIA/NVFlare’s past year of commit activity
  NVIDIA Federated Learning Application Runtime Environment

  pythondecentralizedpet+ 4

  pythondecentralizedpetprivacy-protectionfederated-learningfederated-analyticsfederated-computing

  Python

  •

  Apache License 2.0

  •270270 forks•953953 stars•66 issues•2323 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cuda-python

  Public

  NVIDIA/cuda-python’s past year of commit activity
  CUDA Python: Performance meets Productivity

  Cython

  •

  Apache License 2.0

  •317317 forks•3.3k3.3k stars•209209 issues•7575 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cloudai

  Public
  CloudAI Benchmark Framework

  Python

  •

  Apache License 2.0

  •5858 forks•9797 stars•2020 issues•1818 pull requests•Updated Aug 6, 2026Aug 6, 2026

• Megatron-LM

  Public

  NVIDIA/Megatron-LM’s past year of commit activity
  Ongoing research training transformer models at scale

  transformersmodel-paralarge-language-models

  transformersmodel-paralarge-language-models

  Python

  •

  Other

  •4.3k4.3k forks•17k17k stars•374374 issues•732732 pull requests•Updated Aug 6, 2026Aug 6, 2026

• nvbench

  Public
  CUDA Kernel Benchmarking Library

  benchmarkperformancegpu+ 4

  benchmarkperformancegpucudanvidiacuda-kernelskernel-benchmark

  Cuda

  •

  Apache License 2.0

  •116116 forks•914914 stars•6363 issues•99 pull requests•Updated Aug 6, 2026Aug 6, 2026

• NV-Kernels

  Public
  Ubuntu kernels which are optimized for NVIDIA server systems

  7979 forks•110110 stars•00 issues•1111 pull requests•Updated Aug 6, 2026Aug 6, 2026

• sphinx-llm

  Public
  LLM extensions for Sphinx Documentation

  documentationsphinx-docsphinx-extension+ 1

  documentationsphinx-docsphinx-extensionllm

  Python

  •

  Apache License 2.0

  •1111 forks•3636 stars•88 issues•33 pull requests•Updated Aug 6, 2026Aug 6, 2026

• k8s-test-infra

  Public
  K8s-test-infra

  Go

  •

  Apache License 2.0

  •2828 forks•4949 stars•7777 issues•1212 pull requests•Updated Aug 6, 2026Aug 6, 2026

• pldm

  Public

  NVIDIA/pldm’s past year of commit activity
  C++

  •

  Apache License 2.0

  •6767 forks•66 stars•00 issues•22 pull requests•Updated Aug 6, 2026Aug 6, 2026

• phosphor-state-manager

  Public
  C++

  •

  Apache License 2.0

  •2626 forks•33 stars•00 issues•00 pull requests•Updated Aug 6, 2026Aug 6, 2026

• OpenShell

  Public
  OpenShell is the safe, private runtime for autonomous AI agents.

  Rust

  •

  Apache License 2.0

  •1.2k1.2k forks•8k8k stars•308308 issues•107107 pull requests•Updated Aug 6, 2026Aug 6, 2026

• topograph

  Public
  A toolkit for discovering cluster network topology.

  kubernetestopologynetwork-topology+ 8

  kubernetestopologynetwork-topologygpuschedulingcncfslurminfinibandslinkynvlink+ 1

  Go

  •

  Apache License 2.0

  •3333 forks•151151 stars•88 issues•77 pull requests•Updated Aug 6, 2026Aug 6, 2026

• rumpelpod

  Public
  Orchestrator for LLM coding agents in Docker and Kubernetes pods

  Rust

  •

  Apache License 2.0

  •77 forks•1818 stars•11 issue•00 pull requests•Updated Aug 6, 2026Aug 6, 2026

• nvcf

  Public

  NVIDIA/nvcf’s past year of commit activity
  Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

  kubernetesgpuinference+ 3

  kubernetesgpuinferencenvidiacloud-functionsserverless-gpu

  Go

  •

  Apache License 2.0

  •4343 forks•195195 stars•155155 issues•3939 pull requests•Updated Aug 6, 2026Aug 6, 2026

• cutile-python

  Public
  cuTile is a programming model for writing parallel kernels for NVIDIA GPUs

  pythontilekernel+ 4

  pythontilekernelgputile-based-programmingcutileparallel-kernels

  Python

  •

  Other

  •142142 forks•2.1k2.1k stars•1919 issues•66 pull requests•Updated Aug 6, 2026Aug 6, 2026

• flashdreams

  Public

  NVIDIA/flashdreams’s past year of commit activity
  high-performance inference and serving library for interactive autoregressive video and world models

  interactiveefficiencyworld-models+ 1

  interactiveefficiencyworld-modelsvideo-models

  Python

  •

  Other

  •4343 forks•447447 stars•99 issues•2525 pull requests•Updated Aug 6, 2026Aug 6, 2026

• NeMo-Fabric

  Public
  NVIDIA NeMo Fabric

  Python

  •

  Apache License 2.0

  •1010 forks•2020 stars•00 issues•88 pull requests•Updated Aug 6, 2026Aug 6, 2026

• edk2-platforms

  Public
  NVIDIA fork of tianocore/edk2-platforms

  C

  •

  Other

  •55 forks•1212 stars•00 issues•00 pull requests•Updated Aug 6, 2026Aug 6, 2026