Descrição
Bring state-of-the-art generative AI into Unreal Engine with a plugin designed for ease-of-use, flexibility, and production readiness.
This plugin makes LLMs/VLMs first-class citizens in Unreal Engine by leveraging UE’s Reflection system to automatically derive structured schemas and tool interfaces. Whether you want to prototype quickly or build robust AI-driven features, this plugin provides the foundation.
State-of-the-Art Generative AI
Integrate LLMs and VLMs at runtime and inside the Unreal Editor. Automate content pipelines, accelerate editor workflows, or drive gameplay systems with AI-powered features.
Complete* coverage of OpenAI’s Responses API, Embeddings API plus legacy Completions and Chat Completions API.
Works seamlessly with any OpenAI-compatible endpoint (e.g. Claude, Gemini, Grok, Deepseek, Qwen, Ollama, vLLM).
Agent Framework & MCP Server
Build sophisticated AI agents that autonomously execute multi-turn workflows with delegation and handoff support. But here's where it gets powerful: Host your Unreal Engine tools as an MCP server and make them accessible to external AI agents like Cursor, Claude Desktop, or any MCP-compatible client. Your game logic, editor tools, and custom systems become callable from external applications, bridging your Unreal Engine project with the broader AI ecosystem.
Perfect for AI-assisted development workflows, automated testing pipelines, or letting external agents interact with your game systems.
Supports the Full* AI Workflow
Session-based, strongly typed APIs for multi-turn chats with automatic context management.
Full multi-modality support: text, images, audio, and files.
Custom tool calling with automatic execution and schema generation via Reflection
Structured output with automatic JSON ⇄ UObject conversion and type-safe parsing
Support for OpenAI's hosted tools (File Search, Web Search, Image Generation, Code Interpreter).
MCP Integration: Expose UE tools externally AND use external MCP servers in your code.
Multi-agent framework with delegation, handoff, and autonomous reasoning loops
Full streaming support with granular control and reasoning tokens where available.
Strongly-Typed Tools & Schemas
Define Tools and JSON Schemas directly as UClasses, integrated automatically via Reflection.
Receive strongly-typed UObjects instead of JSON, no manual parsing required
Runtime UObject ⇄ JSON conversion, enabling typed parsing of derived UObject classes both at runtime and in-editor.
This plugin includes the JSON Object & Schema Utility Plugin!
Community & Resources
Disclaimer
While this plugin is quite mature, it is still considered BETA until we have confirmed the plugin works stable across platforms, engine build versions and configurations.
*Everything except the Computer Use Tool