RGB MoCap is a free, open-source Windows app from toyxyz that turns ordinary video into editable 3D human animation, with every AI model running locally on your own machine. No suit, no cloud, no per-second billing.
It is not a single model — it is a front end that wraps several research models behind one interface, lets you compare them, and handles the cleanup and export most raw research code leaves to you.
What It Does
- Reconstruct one or several people from video, previewing body mesh and bones
- Foot and palm contact correction with editable contact timings — the fix for foot sliding
- Finger refinement via optional HaMeR
- Retarget to Mixamo FBX, VRM and PMX characters
- Export FBX or BVH (Generic/Blender or 3ds Max Biped), VMD for MMD, or a portable Blender project with animation, video and cameras
- Multi-camera capture through MAMMA
- Live webcam preview through PEAR (experimental)
The Models Inside
ExMR, FlowHMR and GVHMR are installed by default; MAMMA and PromptHMR are optional. The author’s own tests found PromptHMR better at placing multiple people relative to each other in one video, but with lower overall motion quality than ExMR — and no finger tracking.
Requirements — Bigger Than “Free” Suggests
- 64-bit Windows only
- A compatible NVIDIA GPU and driver, plus OpenGL 4.3
- About 41 GiB of disk for the three default models with add-ons, Blender and FFmpeg — roughly 63 GiB for all five offline models
- MAMMA and PromptHMR additionally need Visual Studio 2022 C++ Build Tools, the Windows SDK and CUDA Toolkit 12.8
Memory is better than you might expect: the author measured peak VRAM falling to about 3.9 GiB for ExMR and 2.8 GiB for FlowHMR in low-memory mode.
The Licence Detail That Matters
RGB MoCap’s own code is MIT. The AI model files are not — they retain their own licences, and some require registration and accepting provider terms before download. If your work is commercial, read each model’s terms in the app’s Model Manager and the repo’s third-party notices. “The app is free” and “the output is cleared for commercial use” are different statements.
Compare it with the alternatives in our AI mocap comparison, and see why AI mocap gets hands and feet wrong.
Creator: toyxyz · Price: Free · Licence: MIT (app), models under their own terms · Requires: Windows, NVIDIA GPU