Skip to content
Media 1 for listing AI for NPC, MetaHuman - Dialog, actions and general intelligence - by Convai

Description

Convai enables NPCs with intelligence such that they can converse naturally with players via text or voice and can carry out advanced actions as an enemy, companion, or filler bot. This Unreal plugin has integrations with all of Convai’s APIs to integrate with your characters and game assets. Check out this overview video to learn more about this plugin, and visit the documentation for tutorials and more details.

Have questions or need assistance?

Visit the Convai Developer Forum – our dedicated community and support team are here to help with bug reports and technical queries.

Get the support you need and connect with other developers to enhance your experience.

Highlights:

  • Intelligent realtime open-ended conversation capabilities, enabling natural and dynamic interactions.

  • Multiple languages support.

  • Actions: Characters can understand the environment and can perform actions based on conversation, verbal commands, and events, opening up new possibilities.

  • Knowledge Base: You can add potentially unlimited knowledge for your characters making them an expert at a topic or grounding them to the lore of the world and their backstories.

  • Multiplayer support: Voice chat between multiple players and characters.

  • Intelligent Animations: Integrated with Lip-Sync, facial and body animations with conversation flow.

Lip-Sync:

Pixel Streaming Support:

Resources:

Sample Projects:

MacOS Microphone Permission Issue:

  • The Convai plugin requires microphone access in Unreal Engine (UE) 5.0 and 5.3 on MacOS. Find steps on how to enable microphone access here.

Compatibility:

  • Compatible with all character and avatar assets. Metahumans, Daz3D, Reallusion, ReadyPlayerMe, and any humanoid or non-humanoid assets can be integrated. 

Standalone components:

  • Text to Speech (TTS) and Speech to Text (STT) capabilities.

  • Update character based on in-game events. Characters' personalities, backstories, and knowledge can be updated in real-time during gameplay.

Coming soon:

  • Other Platforms (IOS - Linux)

  • Long-term memory for characters.

Unreal Engine 4 compatibility:

  • Compatible with Unreal Engine versions 4.26 and 4.27, check our documentation link for a hassle-free installation process.

  • Note that UE 5.0 version is no longer being updated on the marketplace, you can get the latest 5.0 plugin by following this guide.

Experience the future of interactive storytelling with our plugin. Sign up today and take your projects to the next level!

Included formats

  • logo of Unreal Engine format