Skip to content

v8: latest CUDA libraries and ~10% faster

Compare
Choose a tag to compare
@github-actions github-actions released this 12 Mar 06:43
· 368 commits to master since this release
  • This release upgrades the cuda libraries to their latest version. Models are observed to be accelerated by ~1.1x.
  • vsmlrt.CUGAN() now accepts a new parameter alpha, which controls the strength of filtering. Setting alpha to non-default values requires the Python onnx package (but this might change in the future.)
  • Added tf32 parameter to the trt backend in vsmlrt.py. TF32 acceleration is enabled by default on the Ampere GPUs, mostly for fp32 inference, and it has no effect on other architectures.