[D] Which open source models can replicate wonder dynamics's drag'n'drop cg characters?

• segment-anything

  56 44,585 0.0 Jupyter Notebook

  The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• E2FGVI

  1 952 1.3 Python

  Official code for "Towards An End-to-End Framework for Flow-Guided Video Inpainting" (CVPR2022)

  

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• XMem

  11 1,608 6.3 Python

  [ECCV 2022] XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model

Use Segmentation Model (SAM) combined with Inpainting model (E2FGVI) and Xmem to cut out the live action subject.

• Track-Anything

  16 6,138 1.0 Python

  Track-Anything is a flexible and interactive tool for video object tracking and segmentation, based on Segment Anything, XMem, and E2FGVI.

The Track-Anything tool already implements this

• openpose

  36 30,076 5.1 C++

  OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

  

Perhaps something like OpenPose for pose estimation?

• lama

  17 7,326 5.1 Jupyter Notebook

  🦙 LaMa Image Inpainting, Resolution-robust Large Mask Inpainting with Fourier Convolutions, WACV 2022

  

You may be able to remove the actor with lama. https://github.com/advimman/lama

Suggest a related project