TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	4	6232	January 10, 2025
Best practices for reporting an issue or bug relating to TensorRT	0	9015	September 21, 2018
TensorRT inferior scalability on A10, L4 possibly due to locking issues	3	47	June 22, 2026
Compute bottleneck evaluating multiple trajectories through a 7B VLM (VLA Architecture Design) tensorrt , cuda , nemo , llm	0	19	June 21, 2026
On Board Gpu cudnn	2	33	June 19, 2026
Latency Gains using TensorRT	1	36	June 19, 2026
2:4 sparsity doesnot improve inference performance on RTX 3090 tensorrt	15	3737	June 4, 2026
Request for NVIDIA NIM API Rate Limit Increase (40 → 200 RPM) nim , agentic-ai , deepseek	3	113	June 4, 2026
Tensorflow Container for use on H200? cudnn	4	83	June 2, 2026
Problem with accessing resources: TensorRT libraries not found. Check that current user has access to GPU camera	1	52	May 30, 2026
TensorRT Custom Plugin Produces Non-Deterministic Results with Identical Inputs Across 20 Iterations cuda , kernel , cudnn	1	50	May 30, 2026
Adivce regarding batch size, multiple cameras and large image buffers	3	51	May 30, 2026
ONNX model with less nodes or simplified runs slower	1	49	May 30, 2026
Strange changes in file size when deployed with tensorrt tensorrt	9	973	May 30, 2026
Windows 11 + WSL2 Docker Desktop + RTX 5060 Ti 16GB: System GUI severe lag after idle hours with AI inference running (nvlddmkm.sys high DPC latency) cuda , kernel , ubuntu , gaming	3	196	May 30, 2026
Fail to Build the TRT Engine of a multi-GatherND ONNX Model for large input volume tensorrt , cudnn , onnx	1	58	May 30, 2026
Question Regarding INT8 Accuracy Degradation on Turing GPUs with TensorRT 10.11 tensorrt , yolo , cudnn	2	116	May 20, 2026
TRT 10.14: dynamic-shape InstanceNormalization crashes with CUDA 720 in __myl_Inor kernel cudnn , deepstream	4	95	May 11, 2026
Request to enable "Public API Endpoints" permission for my personal organization ai-training , chinese , nim	2	152	May 8, 2026
Missing Public API Endpoints permission in Personal Organization – 403 Forbidden on integrate.api.nvidia.com	1	171	April 30, 2026
Deploying spconv-based 3D detection model (PillarNet) with TensorRT on aarch64 GB10 — libspconv SM120 missing	5	241	April 30, 2026
Error Code: 9: Skipping tactic 0x001526e231ae2e51 due to exception Cask convolution execution tensorrt	3	386	April 30, 2026
[CUDA][WSL2][MPS] CUDA OOM with >14 MPI ranks under WSL2; MPS not starting cuda	2	216	April 30, 2026
Issues with Using TensorRT on Jetson Orin Nano tensorrt , jetson	3	202	April 30, 2026
Model outputting NaNs tensorrt , cudnn , onnx	3	231	April 20, 2026
Custom layer fails when loading from engine file cudnn	3	95	April 14, 2026
Open-Source CLI Agent Framework for NVIDIA AI Endpoints - Seeking Feedback cudnn , ai , open-source-software , api , jetson , nim , llama , agentic-ai , deepseek , nemotron	4	337	April 9, 2026
EfficientDet training with customdata and resulting 0 mAP in evaluation:	11	311	April 3, 2026
Pthread_rwlock_rdlock is taking very long during TRT ExecutionContext::enqueue nsight	3	93	April 2, 2026
[NVIDIA Sizing LLM Inference Systems] Request for additional lab hours cudnn , ai-training	1	63	April 2, 2026

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…