PRODUCT TYPE
C++ Code Plugin (Runtime module: LiteRTLMUnreal). Number of Blueprint assets: 0. No content assets are required.

PUBLIC API
• 8 Unreal UCLASS types, 13 USTRUCT types, and 86 public Blueprint-callable UFUNCTIONs.
• Public Unreal C++ headers for Quick Chat, persistent Agent conversations, streaming/non-streaming generation, request/history control, runtime diagnostics, tool calls, and MCP gateway integration.
• Native SDK access and a stable C ABI are included so C++ projects can extend the plugin without reimplementing runtime features.

CONVERSATION MODELS
• Quick Chat: default single-conversation compatibility API.
• Agents: one persistent object per NPC/conversation, each with independent history/context while sharing the loaded model/runtime.

ENGINE / BUILD
• Separate packages for UE 5.6, 5.7, and 5.8.
• Built and validated with VS2026 (VS18/MSVC 14.51).
• Supported development platform: Windows.
• Supported target platforms: Win64 and Android ARM64.

RUNTIME
• Local .litertlm inference; no cloud service, API key, or network replication.
• Required third-party runtime libraries are bundled for supported targets.
• A compatible .litertlm model is required and not included.
• GPU-only inference; no CPU fallback.
• Android memory planning reads device/process memory and selects safer context limits. Actual support depends on GPU/driver capability and sufficient memory.

DOCUMENTATION
https://winyunq.github.io/LiteRT-LM-Unreal/

DEMO RELEASE
https://github.com/winyunq/LiteRTDemo/releases/tag/v5.1.0

winyunq

winyunq

Product types