MR TV Mozaik: A New Mixed Reality Interactive TV Experience



MR TV Mozaik: A New Mixed Reality Interactive TV Experience

MR TV Mozaik: A New Mixed Reality Interactive TV Experience
Research Paper / ISMAR / Oct 2017 / Immersive/AR/VR/MR, Human Machine Interface

Technicolor has been investigating how Mixed Reality technology could impact the future of home entertainment. We have designed and implemented a system to extend a standard TV experience with AR content, using a consumer tablet or a headset. A virtual TV mosaic is displayed around the TV screen and used as a GUI to control both TV and MR content. Using this interface, the user is able to switch TV content, display meta-data in AR (subtitles, text information or program guide), enhance TV content with interactive 3D objects blended in the environment, or play a game in interaction with the real world. The interactions between the real and the virtual worlds are handled thanks to a scene analysis pre-processing stage, which provides information about both the geometry and the lighting of the real environment. The real-virtual interactions strongly contribute to reinforcement of the immersion feeling. User feedback shows that the concept is very promising.