Realtime Motion Capture & Superimposing Tool
Software Development Team
Software Development, Consulting, Technical Direction, Research & Development, Coordination
May 2019
The Challenge:
To educate and entertain participants while learning about the past 32 years of the last emperor of Japan’s reign.
How:
To create an interactive experience that took participants back in time to key moments in history.
Technology:
- 10m wide LED screen
- NHK’s extensive video library
- Unity
- Body tracking and super-imposing
Due to time constraints we decided to give it a simple, pop-style, almost over-the-top look, focusing on fun rather than realistic visuals. Our company handled all coordination, planning, development both in terms of visuals, the software and the hardware. We used the cameras RGB sensor to superimpose the persons face over the 3D model that was being animated using the depth sensing camera and body tracking code we created.
Body tracking was done using the latest Intel Realsense cameras, and the motion tracking and animation software was developed in-house for the event. We used the cameras RGB sensor to superimpose the persons face over the 3D model that was being animated using the depth sensing camera and body tracking code we created.
