Cross Hand Pose lets your UE5 VR/XR characters recognize static hand gestures in real time.

🖐️ Built for any hand-tracking stack, this plugin reads already-driven SkeletalMesh or PoseableMesh hand components and detects static poses with geometric rules — no training, no reference-pose capture, and no dependency on PICO, Meta, or OpenXR plugins. Add Cross Hand Pose Recognizer to your VR pawn, import a Bone Map DataTable, assign left/right hand mesh names, keep Detect Mode = Rule Based, then bind Blueprint events to build pinch-to-grab, fist-to-action, point-to-select, and more.

✨ Simple Blueprint workflow

A single recognizer component manages both hands. Import bundled CSV bone maps for PICO OpenXR and UE Mannequins XR, create a HandBoneMapPreset DataAsset, and wire clear events: OnPoseStarted, OnPoseEnded, OnPoseChanged, and OnPoseUpdated. Query helpers include GetCurrentPose, IsPoseActive, and IsOpenPalmIdle. Hysteresis, exit confidence, and minimum hold time reduce flicker on sensitive hand tracking. Suitable for VR interaction, XR UI, NPC gestures, tool selection, and digital-human input.

👌 Eight gestures out of the box

Detects Pinch, FiveGrab, Fist, Point, ThumbsUp, OpenPalm, Victory, and Gun with priority-aware rule evaluation. Swap hand skeletons by editing Bone Map CSV → DataTable — no C++ recompile. Optional Reference Pose mode supports encoded-rotation matching for advanced custom gestures via CaptureEncodedPose.

🎚️ Configurable and platform-agnostic

Supports component-name or tag-based hand resolution, per-side Bone Map overrides, Open Palm Policy (Idle / Explicit / Disabled), tunable rule thresholds, RulePreset DataAssets, ValidateBoneMaps diagnostics, and bLogRuleDebug for tuning. Works with PICO Hand Tracking, OpenXR, Meta, or any solution that drives a hand mesh. Tick runs after hand drivers (TG_DuringPhysics) for stable sampling.

🎬 Demo video

CrossHandPoseShow.mp4

Note: In this demo, hand motion capture is provided by PICO OpenXR (driving the left/right hand meshes). Static gesture recognition is handled by Cross Hand Pose via Rule Based detection and Blueprint events. Other scene content, character setup, and gameplay logic shown in the video are outside this plugin’s scope.

📘 Documentation

English: Usage_Guide.pdf

中文: Usage_Guide_zh.pdf

🗺️ Bundled Bone Map reference

See the documentation for CSV column definitions, logical bone enums, and step-by-step DataTable import. Default maps: Pico_Left / Pico_Right and MannequinsXR_Left / MannequinsXR_Right.

Requires Unreal Engine 5.6 / 5.7 / 5.8, a project with existing hand tracking that drives left/right hand meshes, and Bone Map setup before first use. This plugin does not provide hand tracking — it only recognizes poses from meshes your project already animates. Supported target platforms: Win64, Mac