NVIDIA Developer Forums

Deep Learning (Training & Inference) TensorRT

Topic		Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…		6	5968	January 10, 2025
Best practices for reporting an issue or bug relating to TensorRT		0	8845	September 21, 2018
Deprecation of TensorRT static libraries on Linux tensorrt		0	1	May 19, 2025
Nvshmem3.2.5+doca2.9.1failed to detect nvidia-peermem.ko		1	7	May 19, 2025
Dynamic Engine files		1	7	May 19, 2025
TensorRT for combined encoder/decoder model		0	10	May 14, 2025
Building RAG Agents with LLMs		1	15	May 12, 2025
Deepseek Resources requirements ( Deepseek-R1 7B) ubuntu		1	21	May 12, 2025
You have exhausted the lab time provided with your course enrollment. If you believe this message is in error, please contact support. Please help		2	15	May 8, 2025
Big difference between infer results of onnxruntime and tensorrt cudnn		3	91	May 8, 2025
Onnx2trt --fp16 error cudnn		2	21	May 8, 2025
Trtexec exports engine with error (out of memory) cudnn		0	20	May 8, 2025
Rapid Application Development with Large Language Models (LLMs) code not working, won't connect to llms		1	9	May 6, 2025
Trtexec Segfault at PointWiseFusion tensorrt , nvbugs , cudnn		0	12	May 5, 2025
Optimizing Rendering with AI: Reducing GPU Load for Faster Processing tensorrt , cuda , ai , gpu		1	38	May 3, 2025
High GPU usage during simple model inference on Tensorrt cudnn		1	20	May 2, 2025
TensorRT engine fails to deserialize, despite being built with the same version on the same machine cudnn , deepstream		3	37	May 1, 2025
Tensor RT engine to faster rcnn model tensorrt , cudnn		2	21	May 1, 2025
Where to download libnvinfer.so.10 for aarch64-Linux cudnn , llama		0	33	May 1, 2025
Quantization of D-FINE in tensorrt 10.8 fails tensorrt , cudnn , onnx		3	48	April 30, 2025
Slow inference on custom model cuda , tensorflow , cudnn , jetson		3	25	April 30, 2025
Windows systems perfomance issue tensorrt , inference-server-triton		1	20	April 30, 2025
TensorRT engine execution return all 0 due to warning[ScatterND with reduction=='none' only guarantees to be correct if indices are not duplicated.]		1	18	April 30, 2025
Failed to convert the SAM2.1 decoder onnx model due to Error Code 4: Internal Error		1	32	April 30, 2025
How to deploy Grad-CAM using TensorRT tensorrt , cudnn		1	35	April 30, 2025
Techniques to Imporve TensorRT Model Inference Speed tensorrt , cudnn		0	15	April 30, 2025
OpenCV library with CUDA Support on Jetson JetPack Integration cuda , cudnn		0	12	April 30, 2025
Jetson Orin with Yolo cudnn , jetson		2	20	April 29, 2025
The TensorRT engine produces different inference results when loaded using Python compared to C++ cudnn , deepstream		2	24	April 28, 2025
Seeking Guidance for Developing a Custom Generative AI-Driven Conversational UI for Electronic Devices conversational-ai , generative_ai , llm		3	32	April 24, 2025

Powered by Discourse, best viewed with JavaScript enabled