Triton Model Navigator v0.5.4

• new: Custom implementation for ONNX and TensorRT runners

• new: Use CUDA 12 for JAX in unit tests and functional tests

• new: Step-by-step examples

• new: Updated documentation

• new: TensorRTCUDAGraph runner introduced with support for CUDA graphs

• fix: Optimal shape not set correctly during adaptive conversion

• fix: Find max batch size command for JAX

• fix: Save stdout to logfiles in debug mode

• Version of external components used during testing:

  • PyTorch 2.1.0a0+fe05266f
  • TensorFlow 2.12.0
  • TensorRT 8.6.1
  • ONNX Runtime 1.14.1
  • Polygraphy: 0.47.1
  • GraphSurgeon: 0.3.26
  • tf2onnx v1.14.0
  • Other component versions depend on the used framework containers versions.
    See its support matrix
    for a detailed summary.