Beschreibung
LLMAI is an AI solution that brings cutting-edge conversational AI directly into your Unreal Engine 5 projects. Whether you're building games, simulations, or interactive applications, LLMAI provides the tools you need to create intelligent, responsive AI systems that can communicate through text, voice, function calling, using OpenAI, LocalAI and now Grok support added in v2.1.
Required Unreal built-in Plugin Dependencies
AudioCapture Plugin
LiveLink Plugin
MetaHuman
Video Demo
Check out the Video Demo - Introduces the Terminal and Rocketeer game demos.
Key Features
💬 Streaming Text Communication
Real-time streaming responses with character-by-character display
Natural conversation flow with immediate, responsive AI interactions
Thread-safe implementation for reliable operation in complex scenarios
🎤 Realtime Voice Communication
Natural voice conversations with OpenAI's, Grok or LocalAI Realtime API
Automatic speech detection and interruptions with Voice Activity Detection (VAD)
Multiple AI voice personalities (8+ voices including Alloy, Echo, Shimmer)
Bidirectional audio streaming with noise reduction
Seamless voice/text switching during conversations
v2.0: Automatic mic gating functionality
🔧 Intelligent Function Calling
AI-controlled game systems - Let AI spawn objects, adjust settings, control gameplay
Blueprint-friendly function definitions created through the Content Browser
Real-time parameter handling with flexible argument support
Function profiles for grouping related AI capabilities
Complete game demonstration through included Rocketeer arcade game and LiveLink Metahuman demo
🎮 Complete Working Demos
Arcade Demo v2.2 Unreal 5.6 - Realtime terminal with learn by example function calling arcade demo and terminal interface.
LiveLink Demo v2.2 Unreal 5.6 - Realtime lip-sync metahuman with function calling and terminal text and voice chat
📚 Documentation
Documenation Portal - Comprehensive Documentation Home
Platform Support
- Unreal Engine 5.6 or 5.7
- Windows 64-bit (Win10/11 x64 required)
Requirements
OpenAI API Key (required for OpenAI functionality)
LocalAI install for hosting LLMs on local machine or local area network
Grok API Key (Required for Grok xAI fuctionality)
Internet connection for AI service communication
Microphone and Headset (for voice input features)
----------------
Transform your Unreal Engine projects with professional AI integration. Download LLMAI today and start building the next generation of intelligent interactive experiences.
Engineered by [Reflective Simulations](https://www.ReflectiveSimulations.com.au)