ℹ️ Note: The images with plugin examples and the demo project were created using the Runtime Audio Importer and/or Runtime Text To Speech plugins. So, to follow these examples, you will need to install these plugins as well. However, you can also implement your own audio input solution using Runtime MetaHuman Lip Sync.

🗣️ Bring your MetaHuman characters to life with real-time, cross-platform lip synchronization!

Transform your MetaHuman characters with seamless, real-time lip synchronization that works completely offline and cross-platform! Watch as your digital humans respond naturally to speech input, creating immersive and believable conversations with minimal setup.

Quick links:

• 🎮 Packaged Demo Project (Windows)

• 📦 Demo source files (UE 5.5)

• 📄 Documentation

• 🎥 YouTube video demonstration

• 💬 Discord support chat

• 📌 Custom Development: [email protected] (tailored solutions for teams & organizations)

🚀 Key features:

• Real-time Lip Sync from microphone input

• Offline Processing - no internet connection required

• Cross-platform Compatibility: Windows, Android, and MetaQuest

• Multiple Audio Sources:

  • Live microphone input (via Runtime Audio Importer's capturable sound wave)

  • Captured audio playback (via Runtime Audio Importer's capturable sound wave)

  • Synthesized speech (via Runtime Text To Speech)

  • Custom audio data in float PCM format

💡 How it works:

The plugin processes audio input to generate visemes (visual representations of phonemes) that drive your MetaHuman's facial animations in real-time, creating natural-looking speech movements that match the audio perfectly.

🎮 Perfect for:

• Interactive NPCs and digital humans

• Virtual assistants and guides

• Cutscene dialogue automation

• Live character performances

• VR/AR experiences

• Educational applications

• Accessibility solutions

🌟 Works great with:

• Runtime Audio Importer - For microphone capture and audio processing

• Runtime Text To Speech - For synthesized speech generation