Siming Wang

3D previs has validated the need for directorial control, but non-3D users still have to build a scene first. Starting from one reference image, I use segmentation and depth estimation with iPhone AR to move objects, plan camera moves, and generate prompts for AI video.

Starting from the feedback gap in ASL learning - learners can understand a demonstration but struggle to judge whether they performed it correctly - I built an XR learning and real-time translation prototype from zero to one. It combines gesture recognition, micro-gestures, speech recognition, and an animation state machine in Unity and Meta Quest, and was iterated into the version presented at AWE USA 2025.

Inspired by Korea’s dopamine site FoodNeverArrives, I turned the lack of immediate reward after resisting a purchase into a working MVP. Skipped purchases become an accumulating balance, while rewards, spending thresholds, weekly reviews, and links to real apps create a save, choose, then spend loop.

To solve multi-system state synchronization and reliability problems in live AI interaction, I built a voice-triggered OSC state machine with Unreal Engine MetaHuman and TouchDesigner. During a three-day public exhibition at Inspace Edinburgh, the installation recorded 422 interactions and 287 completed experiences.