Skip to content

Ai Face-Markerless Facial Mocap

by Legacy developers·Motion Graphics

Illustrative cover generated by AnyPlugins — no product screenshot available.

Why we like it

Stands out in the superhive library as a webcam-based facial mocap route for Blender that skips depth sensors and iPhones. Note that it runs on Windows and needs characters set up with Apple ARKit shapekeys.

What is Ai Face-Markerless Facial Mocap?

Ai Face-Markerless Facial Mocap is a markerless facial motion capture solution for Blender aimed at indie 3D animators. Rather than a depth sensor or iPhone, it works from video on a normal webcam with 30fps support and runs on Windows. The system ships as two parts: a Windows executable that records and generates facial animation data, and a Blender add-on that reads that data to animate your character.

You calibrate your face with neutral and extreme poses, optionally fine-tune the output, then record the animation data or live stream it directly into Blender before retargeting onto your character. It animates up to 24 of the 52 Apple ARKit shapekeys, so the character needs those shapekeys with proper names, a head rigged with a bone for head motion, and eyes rigged with bones or shapekeys. Real-time preview, head and eye tracking, and live recording are included.

An update added data streaming to Unity3d, with a unitypackage in the product folder, plus bug fixes for the add-on. Because the software is built using the Unity3d game engine, antivirus programs such as Norton and Kaspersky may block the camera feed or delete files. A manual, demo file, and demo video are available.

Who is Ai Face-Markerless Facial Mocap best for?

Ai Face-Markerless Facial Mocap is best for indie 3D animators who want to capture facial performance in Blender from a normal webcam and retarget it to characters with Apple ARKit shapekeys.

How much does Ai Face-Markerless Facial Mocap cost?

Ai Face-Markerless Facial Mocap is completely free to download and use.

Key features

  • Captures facial motion from a normal webcam with 30fps recording support, without a depth sensor or iPhone
  • Animates up to 24 of the 52 Apple ARKit shapekeys
  • Head motion tracking, eye tracking, and expression tracking
  • Real-time preview of animations with live animation recording
  • Streams animation data directly to Blender, or records it for retargeting
  • Data streaming to Unity3d, with a unitypackage in the product folder
  • Optional fine-tuning of the output before applying

Tags

#facial mocap#motion capture#Blender#ARKit shapekeys#facial animation#webcam mocap#character animation

Frequently asked questions

Does Ai Face-Markerless Facial Mocap need an iPhone or depth sensor?

Ai Face-Markerless Facial Mocap does not require an iPhone or a depth sensor. It captures facial motion from video recorded on a normal webcam that supports 30fps recording, and it runs on a Windows operating system. The system includes a Windows executable that records and generates the facial animation data, plus a Blender add-on that reads that data to animate your character. You calibrate your face, optionally fine-tune the output, then record or live stream the animation into Blender for retargeting onto your character.

Which Blender versions does Ai Face-Markerless Facial Mocap support?

Ai Face-Markerless Facial Mocap lists support across a wide range of Blender releases, from 2.82 up through 4.0, including 2.83, 2.9, 2.91, 2.92, 2.93, and the 3.x line from 3.0 through 3.6. The download ships as a Python file that serves as the Blender add-on, alongside the Windows executable, a manual, and a demo .blend file. The add-on reads the animation data generated by the executable and applies it to your character inside Blender.

What does my character need to work with Ai Face-Markerless Facial Mocap?

Ai Face-Markerless Facial Mocap requires your character to have Apple ARKit shapekeys with the correct names. Of the 52 ARKit shapekeys, the program animates up to 24; the character does not need all of them, but more shapekeys give better results. The head should be rigged with a bone if you want head animation, though that is optional. Eyes can be rigged with bones as well as shapekeys. You then retarget the recorded animation data onto the character in Blender.

Can Ai Face-Markerless Facial Mocap stream to Unity3d?

Ai Face-Markerless Facial Mocap added support for streaming data to Unity3d in an update, and a unitypackage for it is included in the product folder. Inside Blender, the tool can also stream animation data directly, so you can live stream and record in Blender or record the data first and retarget it afterward. The software itself is built using the Unity3d game engine, which is why antivirus programs such as Norton and Kaspersky may block the camera feed or remove files.

Is Ai Face-Markerless Facial Mocap free?

Ai Face-Markerless Facial Mocap is listed as free in this catalog. Licensing and version details can change over time, so check the developer's page for the current terms before downloading. The full package includes the AI Face software, the Blender add-on file, documentation, and a demo file, giving you what you need to record facial data and retarget it onto a rigged character with Apple ARKit shapekeys inside Blender.

Alternatives to Ai Face-Markerless Facial Mocap

Also in Motion Graphics for Blender.

Similar plugins