Python Tensorrt

Open-source Python projects categorized as Tensorrt

Top 23 Python Tensorrt Projects

  • YOLOX

    YOLOX is a high-performance anchor-free YOLO, exceeding yolov3~v5 with MegEngine, ONNX, TensorRT, ncnn, and OpenVINO supported. Documentation: https://yolox.readthedocs.io/

  • yolo_tracking

    BoxMOT: pluggable SOTA tracking modules for segmentation, object detection and pose estimation models

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • torch2trt

    An easy to use PyTorch to TensorRT converter

  • yolov7_d2

    πŸ”₯πŸ”₯πŸ”₯πŸ”₯ (Earlier YOLOv7 not official one) YOLO with Transformers and Instance Segmentation, with TensorRT acceleration! πŸ”₯πŸ”₯πŸ”₯

  • mmdeploy

    OpenMMLab Model Deployment Framework

  • Project mention: [D] Object detection models that can be easily converted to CoreML | /r/MachineLearning | 2023-07-25
  • TensorRT

    PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT (by pytorch)

  • tensorflow-yolov4-tflite

    YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • yolov5-face

    YOLO5Face: Why Reinventing a Face Detector (https://arxiv.org/abs/2105.12931) ECCV Workshops 2022)

  • tensorrt_demos

    TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet

  • GenerativeAIExamples

    Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

  • Project mention: FLaNK Weekly 18 Dec 2023 | dev.to | 2023-12-18
  • FastMOT

    High-performance multiple object tracking based on YOLO, Deep SORT, and KLT πŸš€

  • inference

    A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models. (by roboflow)

  • Project mention: YOLOv5 on FPGA with Hailo-8 and 4 Pi Cameras | news.ycombinator.com | 2024-05-31

    Great question! I work for a computer vision company (Roboflow) and have seen computer vision used for everything from accident prevention on critical infrastructure to identifying defects on vehicle parts to detecting trading cards for use in video game applications.

    Drawing bounding boxes is a common end point for demos, but for businesses using computer vision there is an entire world after that: on device deployment. This can be on devices like an NVIDIA Jetson (a very common choice), to Raspberry Pis to central CUDA GPU servers for processing large volumes of data (maybe connected to cameras over RTSP).

    Note: There are many models that are faster and perform better than YOLOv5 (i.e. YOLOv8, YOLOv10, PaliGemma). Roboflow Inference that our ML team maintains has various guides on deploying models to the edge: https://inference.roboflow.com/#inference-pipeline

  • Radiata

    Stable diffusion webui based on diffusers.

  • trt_pose

    Real-time pose estimation accelerated with NVIDIA TensorRT

  • yolov4-custom-functions

    A Wide Range of Custom Functions for YOLOv4, YOLOv4-tiny, YOLOv3, and YOLOv3-tiny Implemented in TensorFlow, TFLite, and TensorRT.

  • Savant

    Python Computer Vision & Video Analytics Framework With Batteries Included

  • Project mention: πŸš€ Savant 0.2.6 is Out: Release Notes | /r/savant_video | 2023-11-09

    Website: https://savant-ai.io/

  • Sparsebit

    A model compression and acceleration toolbox based on pytorch.

  • mpv-upscale-2x_animejanai

    Real-time anime upscaling to 4k in mpv with Real-ESRGAN compact models

  • Project mention: What's your experience witch watching movies/animes on 1440P | /r/Monitors | 2023-07-07

    Anime is very blurry when upscaled on 1440p, given that anime isn't even native 1080p to begin with. I found a good solution tho. There is a really great anime upscaler called 2x Animejanai V2.

  • tflite2tensorflow

    Discontinued Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

  • jetson-voice

    ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT

  • Project mention: Dusty-nv containers on Orin Nano | /r/JetsonNano | 2023-06-07

    I've had some trouble running them on a regular Jetson nano. Specifically https://github.com/dusty-nv/jetson-voice. Has anyone tried them with Orin Nano?

  • yolov8_aimbot

    Aim-bot based on AI for all FPS games

  • Project mention: Revolutionize Your FPS Experience with AI: Introducing the YOLOv8 Aimbot πŸ”₯ | /r/computervision | 2023-12-08

    This isn't just another aimbot; it's a next-level, AI-driven aiming assistant powered by cutting-edge computer vision technology. It uses the YOLOv8 model to pinpoint and track enemies with unerring accuracy. Ready to see it in action? Check this out! πŸ‘€ YOLOv8 Aimbot in Action!

  • opti_models

    PyTorch optimizations and benchmarking

  • ComfyUI-Depth-Anything-Tensorrt

    ComfyUI Depth Anything Tensorrt Custom Node (up to 5x faster), licensed under CC BY-NC-SA 4.0

  • Project mention: Show HN: 5x faster depth map generation using tensorrt inside comfyui | news.ycombinator.com | 2024-06-01
  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python Tensorrt related posts

  • [D] Object detection models that can be easily converted to CoreML

    1 project | /r/MachineLearning | 25 Jul 2023
  • 🌠🌟Radiata TensorRT WebUI βš‘πŸŽοΈπŸ’¨

    1 project | /r/DeepFloydIF | 2 Jun 2023
  • 🌠🌟Radiata Stable Diffusion with TensorRT WebUIπŸŽοΈπŸ’¨

    1 project | /r/AITechTips | 2 Jun 2023
  • A1111 just added support for TensorRT for webui as an extension!

    5 projects | /r/StableDiffusion | 27 May 2023
  • Learning Exchange, lets training YoloX

    1 project | /r/deeplearning | 1 Mar 2023
  • Understanding heatmaps

    1 project | /r/computervision | 20 Feb 2023
  • TensorRT txt2img GUI: 20 to 30% speed boost

    1 project | /r/StableDiffusion | 16 Feb 2023
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 5 Jun 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more β†’

Index

What are some of the best open-source Tensorrt projects in Python? This list will help you:

Project Stars
1 YOLOX 9,076
2 yolo_tracking 6,270
3 torch2trt 4,432
4 yolov7_d2 3,130
5 mmdeploy 2,567
6 TensorRT 2,373
7 tensorflow-yolov4-tflite 2,228
8 yolov5-face 1,973
9 tensorrt_demos 1,720
10 GenerativeAIExamples 1,652
11 FastMOT 1,095
12 inference 1,089
13 Radiata 982
14 trt_pose 948
15 yolov4-custom-functions 596
16 Savant 499
17 Sparsebit 321
18 mpv-upscale-2x_animejanai 277
19 tflite2tensorflow 257
20 jetson-voice 169
21 yolov8_aimbot 186
22 opti_models 55
23 ComfyUI-Depth-Anything-Tensorrt 51

Sponsored
Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com