Ai Face-Markerless Facial Mocap is a markerless facial motion capture solution for Blender aimed at indie 3D animators. Rather than a depth sensor or iPhone, it works from video on a normal webcam with 30fps support and runs on Windows. The system ships as two parts: a Windows executable that records and generates facial animation data, and a Blender add-on that reads that data to animate your character.
You calibrate your face with neutral and extreme poses, optionally fine-tune the output, then record the animation data or live stream it directly into Blender before retargeting onto your character. It animates up to 24 of the 52 Apple ARKit shapekeys, so the character needs those shapekeys with proper names, a head rigged with a bone for head motion, and eyes rigged with bones or shapekeys. Real-time preview, head and eye tracking, and live recording are included.
An update added data streaming to Unity3d, with a unitypackage in the product folder, plus bug fixes for the add-on. Because the software is built using the Unity3d game engine, antivirus programs such as Norton and Kaspersky may block the camera feed or delete files. A manual, demo file, and demo video are available.