ort
is an (unofficial) ONNX Runtime 1.18 wrapper for Rust based on the now inactive onnxruntime-rs
. ONNX Runtime accelerates ML inference and training on both CPU & GPU.
Open a PR to add your project here 🌟
- Twitter uses
ort
to serve homepage recommendations to hundreds of millions of users. - Bloop uses
ort
to power their semantic code search feature. - edge-transformers uses
ort
for accelerated transformer model inference at the edge. - Ortex uses
ort
for safe ONNX Runtime bindings in Elixir. - Supabase uses
ort
to remove cold starts for their edge functions. - Lantern uses
ort
to provide embedding model inference inside Postgres. - Magika uses
ort
for content type detection.