10$ Full Body Tracking! I'm proud to release ToucanTrack (in Beta!). Get decent FBT with the power of 2 PS3 Eye Cameras and AI!

This page summarizes the projects mentioned and recommended in the original post on /r/VRchat

Scout Monitoring - Free Django app performance insights with Scout Monitoring
Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.
www.scoutapm.com
featured
InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
  • toucan-track

    Achieving Full Body Tracking for VRChat using 2 cameras and machine learning.

  • ToucanTrack can be found at the following repository: https://github.com/noahcoolboy/toucan-track/tree/main

  • tensorflow-onnx

    Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX

  • They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

  • Scout Monitoring

    Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

    Scout Monitoring logo
  • tflite2tensorflow

    Discontinued Generate saved_model, tfjs, tf-trt, EdgeTPU, CoreML, quantized tflite, ONNX, OpenVINO, Myriad Inference Engine blob and .pb from .tflite. Support for building environments with Docker. It is possible to directly access the host PC GUI and the camera to verify the operation. NVIDIA GPU (dGPU) support. Intel iHD GPU (iGPU) support. Supports inverse quantization of INT8 quantization model.

  • They come in the form of tflite models, so I had to convert them to onnx. I used tf2onnx for converting the pose landmark model and tflite2tensorflow for converting the pose detection model. For improving performance, I had created a small script which modified the landmark models for supporting batch inference. This script is not included in the repository, but do tell me if you need it!

  • mediapipe

    Cross-platform, customizable ML solutions for live and streaming media.

  • If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

  • ailia-models

    The collection of pre-trained, state-of-the-art AI models for ailia SDK

  • If you're looking for the differences in terms of how inference is done, I recommend you take a look at MediaPipe's source code. MediaPipe doesn't use raw code, but uses a "graph" instead (eg. pose_landmark_cpu.pbtxt), which can be visualised using MediaPipe Viz. I also used axinc-ai/ailia-models as the base (preprocessing, inference, postprocessing, etc...) which I further built upon (keypoint refinement, roi from keypoints, filtering / smoothing, etc...)

  • opentrack

    Head tracking software for MS Windows, Linux, and Apple OSX

  • This looks amazing! I really would like to try it out but I don't feel like downloading CL-Eye Platform SDK from a dropbox. Especially since this is usually a paid product. Are there any possible alternatives for this driver? Something like this one? Thank you!

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Mediapipe openpose Controlnet model for SD

    1 project | /r/localdiffusion | 15 Nov 2023
  • MEDIAPIPE on-device diffusion plugins for conditioned text-to-image generation

    2 projects | /r/AR_MR_XR | 3 Jul 2023
  • OpenAI came after our domain because we use GPT in it

    1 project | news.ycombinator.com | 17 May 2023
  • [P] Pattern recognition

    1 project | /r/MachineLearning | 23 Apr 2023
  • mediapipe VS daisykit - a user suggested alternative

    2 projects | 24 Mar 2023