Official Documentation: https://docs.cgpoly.io
A Blender addon for automatic lip-syncing based on audio input.
Cross-platform (Windows, macOS, Linux), works out of the box with ~25 languages.
⚡ Just install it from Blender’s Add-ons panel and you’re ready to go!
NewShapeKeysFeature.mp4
DemoLipSync-v2-scene-only.mp4
Animated Platformer Character by Quaternius
Wall Art 06 by Jarlan Perez CC-BY via Poly Pizza
- 🎤 Converts voice audio into animated mouth shapes
- Interpolates between Shape Key to give natural lips motion
- 🖼️ Projects a viseme spritesheet onto your character’s face (one spritesheet is shipped with the add-on, but you can use your own)
- 🧠 Uses offline speech recognition (Vosk + Phonemizer + eSpeak)
- 🖥️ Fully supported on Windows, macOS and Linux
- 🔜 Future upgrade: Pose-based animation for facial rigs
- Open Blender.
- Go to Edit > Preferences > Get Extensions.
- Look for Lip Sync
- Install it – done!
When you select a Language Model for the first time, Model file is downloaded and cached for future uses (~40Mo, depending on the language).
- Import or create a 3D character.
- Add your movie / sound clip in Video Sequencer
- Go to the Lip Sync tab in the N-panel.
- Select your Language among 30 available languages.
- Click Add Spritesheet on Selection
- Click Set Mouth Area from Edit Mode
- Click Analyze Audio and wait few seconds – your character now speaks!
- Sprite-based viseme projection
- Timeline keyframe baking
- Shapekey-based viseme support
- Pose-based animation
- Characters require no rotation and applied Scale
- Blender 4.4+
- Works on Windows, macOS, and Linux
Found a bug or want to help improve the addon?
Open an issue or submit a pull request – contributions are welcome!
This project is licensed under the GNU General Public License v3.0 or later.
Made with ❤️ by Charley 3D