OnnxStream

Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers. (by vitoplantamura)

OnnxStream Alternatives

Similar projects and alternatives to OnnxStream based on common topics and language

  • DOOM

    DOOM Open Source Release

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • gemm-benchmark

    Simple [sd]gemm benchmark, similar to ACES dgemm

  • onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

  • deepC

    vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

  • FastDeploy

    ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better OnnxStream alternative or higher similarity.

OnnxStream discussion

Log in or Post with

OnnxStream reviews and mentions

Posts with mentions or reviews of OnnxStream. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-07-20.

Stats

Basic OnnxStream repo stats
9
1,781
7.3
12 days ago

vitoplantamura/OnnxStream is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.

The primary programming language of OnnxStream is C++.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com