30 May 2012

Interactive Cubes

Student Project with the User Experience and Creative Services team at Microsoft

This student project titled ‘Wall#’ involved the design and development of an interactive prototype intended to be installed at the Microsoft Store entrance. The installation featured multi-planar projection mapping and interaction via the Microsoft Kinect.

The team of 7 spent 3 months with the UXCS team on site at Redmond, Washington and was charged with conceptualizing, designing and implementing the concept. My role involved working on implementing the homographic transform for distorting the video, in order to map it to the physical contours of the cubes.

I wrote a couple of shaders and a UI within Unity3d to enable dynamic mapping of the content to calibrate the camera. The final version of the prototype, however, used an alternative method employing OpenCV for homography.

The Team