[P] [D]How to get TensorFlow model to run on Jetson Nano?

• keras-onnx

  2 329 4.4 Python

  Discontinued Convert tf.keras/Keras models to ONNX

  

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• onnx-tensorrt

  4 2,785 5.3 C++

  ONNX-TensorRT: TensorRT backend for ONNX

  

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• modeld

  1 0 0.0

  Self driving car lane and path detection

Conversion was done from Keras Tensorflow using to ONNX https://github.com/onnx/keras-onnx followed by ONNX to TensorRT using https://github.com/onnx/onnx-tensorrt The Python code used for inference using TensorRT can be found at https://github.com/jonnor/modeld/blob/tensorrt/tensorrtutils.py

• server

  24 7,509 9.5 Python

  The Triton Inference Server provides an optimized cloud and edge inferencing solution. (by triton-inference-server)

  

There is a stand-alone triton server that will take tensorflow models (and others) and run them directly: https://github.com/triton-inference-server/server/releases/tag/v2.10.0

Suggest a related project