Skip to content

Lip Sync

by Charley3D·Motion Graphics

Images © Charley3D. Used for product review; image policy.

Why we like it

Lip Sync stands out in the Blender extensions library for bundling its speech and phoneme pipeline — Vosk, eSpeak NG and Phonemizer — so analysis runs offline once the language model is cached locally. At the time of listing it had over 36,000 downloads, making it a practical pick for audio-driven mouth animation.

What is Lip Sync?

Lip Sync is a Blender add-on from Charley3D that generates mouth animation directly from a voice recording. Load an audio clip, run the analysis, and the add-on extracts phonemes and writes keyframes for your character's mouth, so no manual keyframing is required. It can drive 3D shape keys or 2D spritesheet mouth shapes, and it integrates with Blender's Video Sequencer. Support for Pose Library animation is listed as upcoming.

Under the hood, the add-on combines Vosk for offline speech recognition, a custom build of eSpeak NG for converting text into timed phoneme sequences, and Phonemizer for phoneme segmentation across languages. More than 25 languages are supported, including English, French, Spanish, German, Russian, Hindi and Mandarin. On first use it downloads the Vosk model for the chosen language, then caches it locally for faster re-analysis and fully offline work afterward.

It runs on Windows, macOS (Intel and Apple Silicon) and Linux, and requires Blender 4.4 or newer. Lip Sync is released under the GNU General Public License v3.0 or later, and a video trailer accompanies the listing.

Who is Lip Sync best for?

Lip Sync is best for blender artists animating character dialogue who want mouth movement generated from an audio track rather than keyframed by hand.

How much does Lip Sync cost?

Lip Sync is completely free to download and use.

Key features

  • Automatic phoneme extraction from voice audio, generating keyframes for mouth movement
  • Support for more than 25 languages, including English, French, Spanish, German, Russian, Hindi and Mandarin
  • 3D shape keys animation and 2D spritesheet mouth shape animation
  • Integration with Blender's Video Sequencer
  • Vosk language models cached locally for faster re-analysis and offline use
  • Speech and phoneme pipeline built on Vosk, a custom eSpeak NG build, and Phonemizer
  • Upcoming support for Pose Library animation

Tags

#Blender#lip sync#animation#phonemes#audio analysis#character animation#shape keys

Frequently asked questions

Does Lip Sync work with Blender 4.4?

Lip Sync is compatible with Blender 4.4 and newer, and the current release is version 2.3.2. It supports macOS on both Apple Silicon and Intel, Windows and Linux. The add-on requests file access to import models and extract libraries to disk, and network access to download voice models. On the Blender extensions site it is listed under the Animation and Sequencer categories.

What languages does Lip Sync support?

Lip Sync supports more than 25 languages, including English, French, Spanish, German, Russian, Hindi and Mandarin. It combines Vosk for speech recognition, a custom build of eSpeak NG for timed phoneme sequences, and Phonemizer for phoneme segmentation across languages. On first use, the add-on downloads the Vosk model for the language you select and caches it locally, so later analyses in that language reuse the stored model rather than downloading it again.

Does Lip Sync work offline?

Lip Sync works fully offline after setup. The first time you use a language, it downloads the required Vosk model over the network, then caches that model on your system. After that there are no repeated downloads and analysis runs offline. The bundled eSpeak NG and Vosk components ship with the add-on for Windows, macOS and Linux. Note that audio analysis can take time depending on your computer.

How do I install Lip Sync?

Lip Sync installs by dragging the downloaded add-on into Blender, or by downloading it and using Install from Disk. Platform-specific builds are provided for Windows, macOS Intel, macOS Apple Silicon and Linux. Once installed, it can generate 3D shape key animation or 2D spritesheet mouth shapes and plug into Blender's Video Sequencer. Support for Pose Library animation is listed as upcoming.

Is Lip Sync free?

Lip Sync is listed as free in this catalog and is released under the GNU General Public License v3.0 or later. For current licensing terms and the full source, check the developer's page. The add-on is developed by Charley3D, and its most recent update, version 2.3.2, included a bug fix in the animator when baking audio with no pose set for the silence viseme.

Alternatives to Lip Sync

Also in Motion Graphics for Blender.

Similar plugins