v2.0.0-rc.7

Breaking: Infallible functions

The following functions have been updated to return T instead of ort::Result<T>:

• MemoryInfo::memory_type
• MemoryInfo::allocator_type
• MemoryInfo::allocation_device
• MemoryInfo::device_id
• Value::<T>::memory_info
• Value::<T>::dtype

Features

• ValueType now implements Display.
• 7f71e6c Implement Sync for Value<T>.
• abd527b Arbitrarily configurable execution providers allows you to add custom configuration options to the CANN, CUDA, oneDNN, QNN, TensorRT, VITIS, and XNNPACK execution providers.
  • This also fixes a bug when attempting to configure TensorRT's ep_context_embed_mode.
• e16fd5b Add more options to the CUDA execution provider, including user compute streams and SDPA kernel configuration.
• bd3c891 Implement Send for Allocator.
• 6de6aa5 Add Session::overridable_initializers to get a list of overridable initializers in the graph.
• c8b36f3 Allow loading a session with external initializers in memory.
• 2e1f014 Allow upgrading a ValueRef or ValueRefMut to a Value in certain cases.
• f915bca Adds SessionBuilder::with_config_entry for adding custom session config options.
• ae7b594 Adds an environment variable, ORT_PREFER_DYNAMIC_LINK, to override whether or not ort should prefer static or dynamic libs when ORT_LIB_LOCATION is specified.
• 1e2e7b0 Add functions for explicit data re-synchronization for IoBinding.
• b19cff4 Add ::ptr() to every C-backed struct to expose ort_sys pointers.
• d0ee395 Implement Clone for MemoryInfo.

Fixes

• b58595c The oneDNN execution provider now registers using a more recent API internally. (Also, with_arena_allocator is now with_use_arena.)
• cf1be86 Remove the lifetime bound for IoBinding so it can be stored in a struct alongside a session.
• Multiple fixes to static linking for Linux, macOS, and Android.
  • 4da5700
  • 2502224
  • c882c58
  • a779c3b
  • b0e7ebe
• b1fb8c0 Sequence::extract_sequence now returns Value<T> instead of ValueRef<T>.
• 542f210 Make Environment and ExecutionProvider Send + Sync.
• fbe8cbf (Sorta) handle error messages for non-English localities on Windows.

Other changes

• API documentation is now back on docs.rs!
• Improved error messages in multiple areas

---

If you have any questions about this release, we're here to help:

• Discord: #💬｜ort-discussions
• GitHub Discussions

Thank you to Brad Neuman, web3nomad, and Julien Cretin for contributing to this release!

Thank you to Thomas, Johannes Laier, Yunho Cho, Phu Tran, Bartek, Noah, Matouš Kučera, Kevin Lacker, and Okabintaro, whose support made this release possible. If you'd like to support ort as well, consider supporting us on Open Collective 💖

💜🩷💜🩷