Programming / vision / nvidia
TensorRT
TensorRT is NVIDIA’s high-performance deep learning inference engine.
TensorRT takes a trained model (from PyTorch, TensorFlow, ONNX, etc.) and optimizes it to run faster on NVIDIA GPUs — especially for inference
- docker install: Docker image