Skip to content

Cache-aware Streaming ASR: up to 5x faster encoder with CUDA graphs#15863

Open
hamuzhan wants to merge 4 commits into
NVIDIA-NeMo:mainfrom
hamuzhan:feat/asr-cache-aware-encoder-cuda-graphs
Open

Cache-aware Streaming ASR: up to 5x faster encoder with CUDA graphs#15863
hamuzhan wants to merge 4 commits into
NVIDIA-NeMo:mainfrom
hamuzhan:feat/asr-cache-aware-encoder-cuda-graphs