Rust Onnx

Open-source Rust projects categorized as Onnx
Edit details
Topics: Rust Machine Learning WASM Tensorflow neural-networks
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 11 Rust Onnx Projects

  • burn

    Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

    • Project mention: 3 years of fulltime Rust game development, and why we're leaving Rust behind | news.ycombinator.com | 2024-04-26

    You can use libtorch directly via `tch-rs`, and at present I'm porting over to Burn (see https://burn.dev) which appears incredibly promising. My impression is it's in a good place, if of course not close to the ecosystem of Python/C++. At very least I've gotten my nn models training and running without too much difficulty. (I'm moving to Burn for the thread safety - their `Tensor` impl is `Sync` - libtorch doesn't have such a guarantee.)

    Burn has Candle as one of its backends, which I understand is also quite popular.

  • tract

    Tiny, no-nonsense, self-contained, Tensorflow and ONNX inference

    • Project mention: Are there any ML crates that would compile to WASM? | /r/rust | 2023-07-03

    Tract is the most well known ML crate in Rust, which I believe can compile to WASM - https://github.com/sonos/tract/. Burn may also be useful - https://github.com/burn-rs/burn.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • wonnx

    A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

    • Project mention: Intel CEO: 'The entire industry is motivated to eliminate the CUDA market' | news.ycombinator.com | 2023-12-14

    The two I know of are IREE and Kompute[1]. I'm not sure how much momentum the latter has, I don't see it referenced much. There's also a growing body of work that uses Vulkan indirectly through WebGPU. This is currently lagging in performance due to lack of subgroups and cooperative matrix mult, but I see that gap closing. There I think wonnx[2] has the most momentum, but I am aware of other efforts.

    [1]: https://kompute.cc/

    [2]: https://github.com/webonnx/wonnx

  • ort

    A Rust wrapper for ONNX Runtime (by pykeio)

    • Project mention: AI Inference now available in Supabase Edge Functions | dev.to | 2024-04-16

    To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:

  • blindai

    Confidential AI deployment with secure enclaves :lock:

  • rust-mlops-template

    A work in progress to build out solutions in Rust for MLOPs

  • onnxruntime-rs

    Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • altius

    Small ONNX inference runtime written in Rust

    • Project mention: Small inference runtime for deep neural networks | news.ycombinator.com | 2023-07-23

  • tractjs

    Run ONNX and TensorFlow inference in the browser.

  • steelix

    Your one stop CLI for ONNX model analysis.

  • yolov5-api-rust

    Rust API to run predictions with YoloV5 models.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Rust Onnx related posts

  • Small inference runtime for deep neural networks

    1 project | news.ycombinator.com | 23 Jul 2023

  • Are there any ML crates that would compile to WASM?

    3 projects | /r/rust | 3 Jul 2023

  • WebGPU ONNX inference runtime written in Rust

    1 project | news.ycombinator.com | 23 May 2023

  • rustformers/llm: Run inference for Large Language Models on CPU, with Rust 🦀🚀🦙

    4 projects | /r/rust | 10 May 2023

  • tract VS burn - a user suggested alternative

    2 projects | 25 Mar 2023

  • onnxruntime

    4 projects | /r/rust | 22 Feb 2023

  • Steelix - CLI for ONNX model analysis

    1 project | /r/deeplearning | 3 Nov 2022
  • A note from our sponsor - SaaSHub
    www.saashub.com | 2 Jun 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Onnx projects in Rust? This list will help you:

Project Stars
1 burn 7,384
2 tract 2,086
3 wonnx 1,517
4 ort 629
5 blindai 493
6 rust-mlops-template 277
7 onnxruntime-rs 262
8 altius 87
9 tractjs 76
10 steelix 43
11 yolov5-api-rust 27

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com