🎙️ Speech in → 🧑 MetaHuman talking. In real time. Zero baking.

Turn any audio into fully animated MetaHuman facial performance at runtime. An NNE / ONNX inference solver converts speech directly into viseme curves and drives your MetaHuman through LiveLink — no offline processing, no pre-baked animation, no waiting.

Feed it a WAV file, a Sound Wave asset, or a live PCM stream, and your character lip-syncs instantly. Perfect for realtime voice agents, TTS-driven NPCs, and interactive digital humans.

video：https://www.youtube.com/watch?v=QZ0JJNjYl5Y

demo：https://drive.google.com/file/d/1XvJPGaxibOuyBTOZVb2qyhEio0c6YNKj/view?usp=sharing

## ✨ Key Features

🔊 Runtime Audio-to-Face

Speech → viseme curves, generated and played live. Nothing baked, nothing precomputed.

📡 Flexible Input — File, Asset, or Live Stream

Play from a WAV file, drive directly from a USoundWave asset in your project (no disk path needed), or push streaming PCM with `BeginAudioStream` / `FeedAudioStream` / `EndAudioStream` — built for realtime voice & TTS pipelines.

🌿 Procedural Liveliness

Automatic blinks, gaze drift, and subtle head micro-motion keep your character alive in both idle and talking states.

😊 Emotion Layer

Rule-based emotion + optional ML emotion recognition (NNERuntimeORT), with full manual override when you want precise control.

🎚️ Tuning Presets

One-click looks — Realistic Dialogue, Cinematic Close-Up, Expressive Stylized, Live Stream Presenter — or go fully custom.

🧩 100% Blueprint-Driven

~90 tunable parameters and complete events (frame generated, playback state, emotion recognized, errors) — all exposed to Blueprint.

👁️ In-Editor Preview

Preview facial output instantly — from a Sound Wave asset or a WAV file, your choice — without entering Play mode.

⚡ One-Call Function Library

Apply generated frames to a SkeletalMesh in a single Blueprint node.

## 📋 Requirements

| Platform | Win64 |

| Dependencies | LiveLink · MetaHumanCoreTech · NNERuntimeORT |

| Asset | An existing MetaHuman character in your project |

## 🤝 Build a Complete Digital Human

Pairs seamlessly with the RealtimeVoice plugin:

🗣️ RealtimeVoice → 👄 MetaHumanAudioToFaceRuntime

realtime voice + realtime lip-sync = a fully interactive talking digital human.