C++ Onnx

Open-source C++ projects categorized as Onnx
Edit details
Topics: Deep Learning Pytorch Machine Learning neural-network Android
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 12 C++ Onnx Projects

  • ncnn

    ncnn is a high-performance neural network inference framework optimized for the mobile platform

    • Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12

    ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.

    https://github.com/Tencent/ncnn

  • onnxruntime

    ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

    • Project mention: New exponent functions that make SiLU and SoftMax 2x faster, at full acc | news.ycombinator.com | 2024-05-15

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • onnx-simplifier

    Simplify your onnx model

  • onnx-tensorrt

    ONNX-TensorRT: TensorRT backend for ONNX

    • Project mention: Introducing Cellulose - an ONNX model visualizer with hardware runtime support annotations | /r/tensorflow | 2023-05-23

    [1] - We use onnx-tensorrt for this TensorRT compatibility checks.

  • FastDeploy

    ⚡️An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ☁️Cloud 📱Mobile and 📹Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

    • Project mention: Testing YOLO on Orange Pi 5 | /r/OrangePI | 2023-07-09

  • OnnxStream

    Lightweight inference library for ONNX files, written in C++. It can run SDXL on a RPI Zero 2 but also Mistral 7B on desktops and servers.

    • Project mention: Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support | news.ycombinator.com | 2024-01-14

  • hls4ml

    Machine learning on FPGAs using HLS

    • Project mention: How to participate in open-source FPGA projects? | /r/FPGA | 2023-08-04

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • Stable-Diffusion-NCNN

    Stable Diffusion in NCNN with c++, supported txt2img and img2img

    • Project mention: Stable Diffusion implemented by ncnn framework based on C++, supported txt2img and img2img! | /r/StableDiffusion | 2023-06-08

  • optimizer

    Actively maintained ONNX Optimizer (by onnx)

    • Project mention: Operationalize TensorFlow Models With ML.NET | dev.to | 2023-08-17

    If you happen to start with an ONNX model that you still want to optimize, then you can use the official ONNX optimizer tool https://github.com/onnx/optimizer.

  • deepC

    vendor independent TinyML deep learning library, compiler and inference framework microcomputers and micro-controllers

    • Project mention: [D] Run Pytorch model inference on Microcontroller | /r/MachineLearning | 2023-11-14

    DeepC. Open source version of DeepSea. Very little activity, looks abandoned

  • vs-mlrt

    Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!)

    • Project mention: Custom Anime4K shaders? | /r/mpv | 2023-07-05

    or whatever you want, you need to write the code yourself though. https://github.com/AmusementClub/vs-mlrt

  • Onnx2Text

    Converts an ONNX ML model protobuf from/to text, or tensor from/to text/CSV/raw data. (Windows command line tool)

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

C++ Onnx related posts

  • New exponent functions that make SiLU and SoftMax 2x faster, at full acc

    2 projects | news.ycombinator.com | 15 May 2024

  • Show HN: OnnxStream running TinyLlama and Mistral 7B, with CUDA support

    1 project | news.ycombinator.com | 14 Jan 2024

  • OnnxStream running TinyLlama and Mistral 7B, with CUDA support

    1 project | news.ycombinator.com | 14 Jan 2024

  • Oracle-samples/sd4j: Stable Diffusion pipeline in Java using ONNX Runtime

    2 projects | news.ycombinator.com | 1 Jan 2024

  • ONNX runtime: Cross-platform accelerated machine learning

    1 project | /r/hackernews | 27 Jul 2023

  • Onnx Runtime: “Cross-Platform Accelerated Machine Learning”

    1 project | /r/hypeurls | 27 Jul 2023

  • Running Stable Diffusion in 260MB of RAM

    1 project | /r/patient_hackernews | 22 Jul 2023
  • A note from our sponsor - SaaSHub
    www.saashub.com | 18 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Index

What are some of the best open-source Onnx projects in C++? This list will help you:

Project Stars
1 ncnn 19,352
2 onnxruntime 12,894
3 onnx-simplifier 3,585
4 onnx-tensorrt 2,772
5 FastDeploy 2,742
6 OnnxStream 1,754
7 hls4ml 1,118
8 Stable-Diffusion-NCNN 943
9 optimizer 603
10 deepC 526
11 vs-mlrt 236
12 Onnx2Text 15

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com