Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
Top 23 C++ Tensorflow Projects
-
-
DeepSpeech
DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
ncnn
ncnn is a high-performance neural network inference framework optimized for the mobile platform
-
-
-
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
TNN
TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts
-
-
STT
🐸STT - The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.
-
-
EdgeML
This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India. (by microsoft)
-
athena
an open-source implementation of sequence-to-sequence based speech processing engine (by athena-team)
-
-
MocapNET
We present MocapNET, a real-time method that estimates the 3D human pose directly in the popular Bio Vision Hierarchy (BVH) format, given estimations of the 2D body joints originating from monocular color images. Our contributions include: (a) A novel and compact 2D pose NSRM representation. (b) A human body orientation classifier and an ensemble of orientation-tuned neural networks that regress the 3D human pose by also allowing for the decomposition of the body to an upper and lower kinematic
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
# L2-normalize the encoding tensors image_encoding = tf.math.l2_normalize(image_encoding, axis=1) audio_encoding = tf.math.l2_normalize(audio_encoding, axis=1) # Find euclidean distance between image_encoding and audio_encoding # Essentially trying to detect if the face is saying the audio # Will return nan without the 1e-12 offset due to https://github.com/tensorflow/tensorflow/issues/12071 d = tf.norm((image_encoding - audio_encoding) + 1e-12, ord='euclidean', axis=1, keepdims=True) discriminator = keras.Model(inputs=[image_input, audio_input], outputs=[d], name="discriminator")
Project mention: ESpeak-ng: speech synthesizer with more than one hundred languages and accents | news.ycombinator.com | 2024-05-01As I understand it DeepSpeech is no longer actively maintained by Mozilla: https://github.com/mozilla/DeepSpeech/issues/3693
For Text To Speech, I've found Piper TTS useful (for situations where "quality"=="realistic"/"natual"): https://github.com/rhasspy/piper
For Speech to Text (which AIUI DeepSpeech provided), I've had some success with Vosk: https://github.com/alphacep/vosk-api
Project mention: AMD Funded a Drop-In CUDA Implementation Built on ROCm: It's Open-Source | news.ycombinator.com | 2024-02-12ncnn uses Vulkan for GPU acceleration, I've seen it used in a few projects to get AMD hardware support.
https://github.com/Tencent/ncnn
Starting from version 1.5.1 the backend integrates changes borrowed from sam_onnx_full_export, to support OnnxRuntime 1.17.x and later versions. Please note that on MacOS directly running the project from the command line suffers from memory leaks, making inference operations slower than normal. It's best therefore running the project inside a docker container, unless in case of development or debugging activities.
Project mention: Does anyone else agree that the links to the latest development version of Open3D don't work? | /r/cscareerquestions | 2023-07-10I was going to file a bug about another issue, but I have to download the development version. This is why I want this solved quickly. None of the links seem to work: https://github.com/isl-org/Open3D/issues/6259
Yet another TEDIOUS BATTLE: Python vs. C++/C stack.
This project gained popularity due to the HIGH DEMAND for running large models with 1B+ parameters, like `llama`. Python dominates the interface and training ecosystem, but prior to llama.cpp, non-ML professionals showed little interest in a fast C++ interface library. While existing solutions like tensorflow-serving [1] in C++ were sufficiently fast with GPU support, llama.cpp took the initiative to optimize for CPU and trim unnecessary code, essentially code-golfing and sacrificing some algorithm correctness for improved performance, which isn't favored by "ML research".
NOTE: In my opinion, a true pioneer was DarkNet, which implemented the YOLO model series and significantly outperformed others [2]. Same trick basically like llama.cpp
[1] https://github.com/tensorflow/serving
spotify/pedalboard: audio effects for Python and TensorFlow
Project mention: Calyx, a Compiler Infrastructure for Accelerator Generators | news.ycombinator.com | 2024-03-04How is this different than the mlir infrastructure of llvm and xla implemented in https://iree.dev/?
Project mention: Frugally-deep: Header-only library for using Keras (TensorFlow) models in C++ | news.ycombinator.com | 2023-12-09
Project mention: Has anyone gotten tensorflow_io to work on their M1 Mac? As far as I can tell there are no solutions. | /r/tensorflow | 2023-07-23Been stuck on this for days. The issue is mentioned in this year old thread, with multiple solutions that dont end up working. https://github.com/tensorflow/io/issues/1625 . If we're on Mac are we just SOL? Never encountered this type of problem before where you straight up cant work because your Mac is incompatible with the necessary software.
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
C++ Tensorflow related posts
-
Side Quest Devblog #1: These Fakes are getting Deep
-
Calyx, a Compiler Infrastructure for Accelerator Generators
-
Why do tree-based models still outperform deep learning on tabular data? (2022)
-
Running pre-trained ML models in Godot
-
TensorFlow-metal on Apple Mac is junk for training
-
Frugally-deep: Header-only library for using Keras (TensorFlow) models in C++
-
Nvidia H200 Tensor Core GPU
-
A note from our sponsor - InfluxDB
www.influxdata.com | 25 May 2024
Index
What are some of the best open-source Tensorflow projects in C++? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | tensorflow | 183,006 |
| 2 | DeepSpeech | 24,457 |
| 3 | ncnn | 19,352 |
| 4 | onnxruntime | 12,960 |
| 5 | Open3D | 10,599 |
| 6 | serving | 6,096 |
| 7 | pedalboard | 4,900 |
| 8 | TNN | 4,302 |
| 9 | EAST | 2,999 |
| 10 | self-driving-car | 2,690 |
| 11 | iree | 2,420 |
| 12 | STT | 2,161 |
| 13 | uTensor | 1,655 |
| 14 | EdgeML | 1,546 |
| 15 | frugally-deep | 1,049 |
| 16 | PoseEstimationForMobile | 991 |
| 17 | athena | 930 |
| 18 | echo | 918 |
| 19 | oneAPI-samples | 860 |
| 20 | MocapNET | 810 |
| 21 | cppflow | 765 |
| 22 | deepbacksub | 729 |
| 23 | io | 690 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com