Unreal Engine Text To Lip Sync UE7549

Text To Lip Sync

It’s a real-time subtitles-based lip sync, i.e. it requires subtitles and audio to create animation. The plugin is using provided text subtitles to generate lips sync animation for characters in real-time. Audio envelope value from the synchronously activated audio component allows to detect silent intervals and to pause animation in this intervals and adjust future animation speed. Subtitles + Sound Asset = LipSync.

Demo video

Tutorial video

>>> Please try executable demo (link below) to weigh quality of an animation before you buy the plugin! <<<

Support (forums)

technical details

Features:

  • easy setup & use
  • using audio envelope value to detect pauses
  • using pauses in audio for real-time animation adjustments (this allow to play quite long audio sequence using a single subtitle line)
  • subtitles can be separated to blocks with in-out time marks to get better result
  • information gathered from audio can be saved to file to improve future animations
  • can automatically load map of phrases from data table
  • sources included

Code Modules:

  •  Text2LipSync (Runtime)

Number of Blueprints: 0

Number of C++ Classes: 4 (1 actor component exposed to blueprints)

Network Replicated: No

Supported Development Platforms: Windows x64

Supported Target Build Platforms: Windows x64

Documentation: pdf + MetaHumans Setup

Example Project: [4.19] [4.26]

Executable Demo (try before you buy)zip

Additional Notes: Please contact me if you need it for educational purposes