Gaël Seydoux, Research & Innovation Director at Technicolor, discusses Volumetric Technology live from the InterDigital booth at MWC19 in Barcelona.

MWC19: Volumetric Technology

Don Tian, Senior Principal Engineer at InterDigital, discusses the importance of video standards as it relates to 5G live from the InterDigital booth at MWC19 in Barcelona.

MWC19: 360° Video Standards

Volumetric content is the future generation of video that is generated by a set of multiple cameras, a Light Field Acquisition system. Join Arno Schubert, Project Manager at Technicolor Research and Innovation for a demonstration on image acquisition with a multi camera set-up, calculating a volumetric portrait that will be rendered on any smartphone for an immersive view experience. See how a volumetric video can lead to an immersive and interactive experience on a simple 2D screen, sensing depth and parallax, like watching a scene through a real window.

MWC19: Volumetric Photobooth

This joint demo of InterDigital Inc. and Technicolor Research & Innovation hosted by Jun Han, Principal Engineer at InterDigital, will showcase 360° video streaming from 13 pre-recorded camera views, each with 2kx2k color and depth, stored in HEVC video format in an MPEG-DASH server. Based on viewer position and orientation, seven camera views are adaptively streamed to the DASH client. Video streaming segments are decoded, views are synthesized and rendered to display in real time at 30fps. See how a Head Tracker tracks a human face, observe motion parallax, and use a joystick to track 360° video views.

360° Video Experience with Adaptive Streaming

MWC19: 360° Video Experience with Adaptive Streaming

During MWC18, InterDigital's Yong He demonstrated an end-to-end 360 video live streaming platform with AR capabilities that is built upon a series of state-of-the-art video standards, including MPEG Ominidirectional Media Format (OMAF), the latest MPEG-Immersive standard, MPEG DASH, and the most efficient video compression standard H.265/HEVC.

MWC18: 5G Video Experience Demo

InterDigital's CCO Patrick Van de Wille takes us on a tour of the MWC 2018 InterDigital booth and provides insight into technology demonstrations, the InterDigital studio space, and other happenings that occurred at the show.

MWC18: InterDigital Booth Tour

Walkthrough-mobile.mp4

At NAB 2017, Ericsson demonstrated 8K 360-degree video experience utilizing InterDigital's 8K content. Check out the demo here!

NAB 2017: InterDigital and Ericsson Demo 8K 360-Degree Video

Perceptual Pre-filtering Explained, MWC 2014

Bill Crean: It’s been an exciting week already at Mobile World Congress. We’ve had a lot of attention on our user-aware video solutions, especially our perceptual prefilter software product, which we’re demonstrating applied to 4K content. Indeed, 4K is a big deal. The key is, it’s here. You can buy the devices, and the content publishers - many of them - have announced that they’re going to deliver the content. So, today, video streaming is on the increase. And even with HD content, there’s a lot of bad user experience. We can all identify with the frustration of dealing with hesitations, hiccups, re-buffering, and reduced resolution when we’re streaming video. Well, 4K’s coming. 4K televisions like these, they have four times the number of pixels. So, even with advanced encoding techniques, there’s a lot more data to push across the content delivery networks. Luckily, our user-aware video products, like our perceptual prefilter, can help the situation. With our perceptual prefilter software product, we understand and utilize the science of the limits of the human visual acuity system. So, we understand that, under certain environmental viewing conditions, there are details in the content that we, as humans, cannot detect. So, what we do with our perceptual prefilter is, we filter out that information that we know will not be seen anyway. As a result, we have a reduced bit rate with no sacrifice of the perceived quality. That translates into better user experience when doing the content. Absolutely. What we’ve been demonstrating this week is our perceptual prefilter applied to 4K content. We’ve got a 33-megabit-per-second stream on one of these displays. And on the other, we’re showing what we’ve prefiltered that happens during the encoding process, and we’ve been able to reduce the bit rate by 40 percent, down to a 20-megabit-per-second stream for this particular content. So, what’s fun this week is seeing people look at the two beautiful displays, and try to guess which is the one - the original stream, and which is the one that’s a 40 percent lower bit rate. And people can’t do it. It’s fun to see people go back and forth, trying to decide, and not being able to make up their mind.

Advanced User Adaptive Video Demo at Broadband World Forum

Presenter: This is a demonstration of a user-adaptive model, with the [stream end] technology. This technology is based on the understanding that the mobile environment devices such as cell phones or tablets can [be hold] differently. For example, the user might be holding tablet in hand, he might put it in his laps, or he might put it on table, on stand of some sort. And, in all those cases, the distance between device and the viewer might be different.

That distance affects the degree to which a viewer is able to discern information on the screen and in our technology, we take advantage of this different environments and process information in a way that is tailored to each different viewing environment and condition, differently, to maximize the quality and minimize the [lured] on network, needed to deliver that information.

They announced this technology about four months ago, at Mobile World Congress in Barcelona, and today, they are showing four different implementations of this technology on different devices, with different form-factors, different access engines and different operating systems.

For example, among implementations that we are showcasing, today is the streaming client from [Real] Networks. It’s called Helix. And, it’s using user-adaptive functionalities that we integrated in. We also have streaming client from [Idiom], and in this particular case, the [Transit] Android and the Transit extremely high resolution, it’s 14, 14p, it’s two times higher than the standard full HD resolution.

Last, but not least, we are also showing streaming client, which is based on [Dash] Industry for Java Script, dash, access engine. Let me now show how it works in details. To start the stream, we select a video clip and press Load. And, the streaming client starts loading the video and around the screen. Our - back message is saying that we detected that in this particular situation, the device is on the stand and it limits the bandwidth to be used by the client, to four megabits.

Now, if I would pick the device and hold close it to myself, video detects the device is now in-hand, and the bandwidth is increasing accordingly. In this particular example, the bandwidth is increased to 5.7 megabits and it will actually increase to six megabits, which is the highest available bandwidth in our set of representations. Right now, it’s up at six megabits.

If I am, again, putting the device away, it will detect that I am further away from the device, that I am not paying attention to it, and it will reduce the load and will reduce the network consumption and will continue to stream the same clip but at lower rate, which is still sufficient, but uses much less of network.

This technology is intended to benefit a number of players in streaming eco-system. The content publishers can benefit from lower CDM costs as the amount of data that will be consumed by end users will be minimized by this technology. The result of use of this technology allows a lower network load on the access networks, in particular mobile networks, or resources that are shared between all users and by lowering consumption at one point, the bandwidth is reused by other users. So, more users will be able to appreciate the video with high quality, and with less buffering.

And, of course, it will benefit end users as it will allow them to enjoy video with high as possible quality and will minimize their wireless bill.

Advanced User Adaptive Video Demo Interview with Yuriy Reznik

Yuriy Reznik: This is the demonstration of user-adaptive video streaming. The purpose of this technology is to minimize load and network [unintelligible] data traffic. It is of particular importance to wireless network where the capacity is shared within users and several users using [more] [unintelligible] [antennas] [unintelligible]. So, the principles that we are using to reduce this load are based on phenomenon of human vision. Is facts such as the human visual acuity limits as well as [unintelligible] sensitivity curve. In a nutshell, we are using some [sort of] signal device, such as front-facing camera, for a proximity sensors to detect the distance between the human and the screen.

For example, I will ask my colleague Ed to stay close to the screen. And as you can see in this example when he is standing close there is not much that we can [save] because there is a broad range of spatial frequencies that he can see and appreciate while looking at the screen. As Ed moves back we can now appreciate more [savings] by removing the spatial frequencies that are no longer visible by human eye. In this particular example the savings are about 70 percent of the bit rate.

This technology can help [several players] in the streaming [unintelligible] systems; content owners and hosting companies can save money by paying less for distribution of the content over [CDMs]; it could help network operators [unintelligible] reduce [unintelligible] their networks and it will help end users as reduced load will increase changes of them receiving content without interruption.

VIDEOS