The Vault

MWC18: 5G Video Experience
Presentation / Feb 2018 / MWC18, 5G, video

In this MWC18 presentation, discover InterDigital's end-to-end 360 video live streaming platform with AR capabilities built on a series of state-of-the-art video standards and enhanced via multi-access edge computing.

© 2018 InterDigital, Inc. All Rights Reserved. 5G Video Experience VR/AR Live Streaming © 2018 InterDigital, Inc. All Rights Reserved. © 2018 InterDigital, Inc. All Rights Reserved. Social Experience Sharing 5G Video Experience 360° Immersive MediaUHD Video Streaming VR and AR 2 Immersive Experience Immersive Content 4K, 8K, 12K, 24K…ü 60fps, 90fps, 120fps…ü HDR, panoramic, 360ü ° Stereoscopic, light field, volumetric, etc. ü Network Access High throughput ü Extreme capacityü Ultra low latencyü Quality of Experience(QoE)ü Devices Intelligent onü -device tracking High resoluQon/frameü -rate, FoV, PPI Power, thermal, cost, etc. ü © 2018 InterDigital, Inc. All Rights Reserved. 3 Services Retail• Healthcare• Real estate• Military• Educa2on• Engineering• © 2018 InterDigital, Inc. All Rights Reserved. • Virtual cinema/movie theater • Enhanced personal points of view video. VR. AR. Communica4ons Social event sharing• Immersive storytelling• VR conferencing & telepresence• Personal or professional experience sharing• Interac2ve gaming, explora2on, shopping, etc. • Live music concerts, sports, fashion shows• Entertainment 4 VR Related SDOs and SIGs © 2018 InterDigital, Inc. All Rights Reserved. 5 InterDigital Virtual Reality/Augmented Reality InterDigital Technologies• Real• -&me live video acquisi&on Real• -&me &led-based HEVC video encoding Viewport adap&ve technology to improve network bandwidth usage efficiency• Augmented reality inside 360• ° video to enhance the live streaming experience Hybrid RTMP and DASH live streaming server/client to support low latency VR experience• Compliant with the latest MPEG immersive standard (OMAF)• Targets & Objec=ves• Showcase state• -of-the-art AR/VR technologies Seek partners and/or customers for further development towards immersive• AR/VR applica&ons © 2018 InterDigital, Inc. All Rights Reserved. 6 InterDigital VR/AR Live Streaming Pla5orm Real-Time 4K VR 360 Acquisi5on © 2018 InterDigital, Inc. All Rights Reserved. Tiled 360 Video Encoding User Interac5ve AR/VR Rendering OMAF Viewport Adap5ve DASH StreamingTiled HEVC Encoding OMAF Live Streaming Server Viewport extrac5on OMAF VR/AR Client Tile0, high quality Tile0, low quality Tile1, high quality Tile1, low quality Tile2, high quality Tile2, low quality AR/VR Rendering AR HEVC Decoder and Viewport Extrac5on AR HEVC Decoder and Composi5on DASH Streaming Client View Orienta=on Tracking AR/VR Rendering 360 Camera 7 © 2018 InterDigital, Inc. All Rights Reserved. 5G Video Experience Enhanced via MulC-Access Edge CompuCng © 2018 InterDigital, Inc. All Rights Reserved. Mul$-Access Edge Compu$ng – 5G Enabler 9 • MEC embeds application resources closer to end-users and devices • Foundational technology to realize 5G services and application verticals: • Low latency, network and app efficiency, adaptability, and context awareness • AR/VR media, mission critical automation, automotive, gaming, massive IoT, etc. • With virtualization, edge resources extend across the network: • “Far Edge” of the network – small cells, Wi-Fi networks, vehicles, etc. • 3rd party edge providers offering resources into the 5G system Distant Cloud CDN 3rd Party ProviderEdge Cloud Far Edge Cloud Macro Cell Mini Data Center Small Cell Network MEC Pool MEC Pool Wi-Fi Network Vehicle Edge Personal Edge MEC MEC Vehicle Edge Far Edge CloudEdge Cloud Core Network Private Cloud Public Cloud © 2018 InterDigital, Inc. All Rights Reserved. © 2018 InterDigital, Inc. All Rights Reserved.10 Edge-Enabled – 5G Video Experience FLIPS Live AR/VR Stadium Use Case – Localized Video for the Olympics Simultaneous acAviAes • spread across the venue; not all events visible from any one seaAng locaAon Venue offers fans a • 5G Video Experience with live 360° VR viewing from several locaAons throughout the venue AR supplements the user • experience with content provided by the venue and independent 3rd parAes (such as other fans or even athletes) Drones – Overhead View User in Stands Play-Level View Venue AR Content MEC AR Proxy App 360 Video Edge Server Athlete Live Streaming Alternate Views – Row 1 View Near Key Event 11 Edge-Enabled – 5G Video Experience FLIPS Localized AR/VR video processing highlights key MEC aspects Efficient Network U;liza;on1. Edge video processing server • reduces video bandwidth throughout the network Low Latency2. Live video required latency • within human delay tolerance MEC Edge Services3. MEC interconnects VR • and AR content sources Live AR/VR Stadium Use Case – Localized Video for the Olympics Drones – Overhead View User in Stands Play-Level View Venue AR Content Athlete Live Streaming MEC AR Proxy App 360° Video Edge Server Alternate Views – Row 1 Seat View Near Key Event © 2018 InterDigital, Inc. All Rights Reserved. 12 Edge-Enabled – 5G Video Experience InterDigital’s • AdvantEDGE Pla-orm provides an emulated edge network InterDigital’s • VR/AR Live Streaming Pla-orm deployed at the Edge via AdvantEDGE Pla>orm 360• ° camera for live video content AR/VR Clients: Goggles and display • Emulated terminals providing AR • content Drag and drop the AR/VR clients • into various locaJon zones An edge service matches AR • content with 360° VR video, depending on locaJon zone Live AR/VR Stadium Use Case– Localized Video for the Olympics © 2018 InterDigital, Inc. All Rights Reserved. MEC Edge Node © 2018 InterDigital, Inc. All Rights Reserved.13 Edge-Enabled – 5G Video Experience VR/AR MEC App Deployment via Mobile Edge Emulaorm, AdvantEDGE PoA #1 PoA #2 PoA #3PoA #4 Edge Host Bridge AR Proxy MEC App MEC Service Video Pla1orm MEC App – Hosted on External Node IP Camera – UE Hosted on an External Node Four PoA’s – one PoA per MEC Location Zone VR Clients – Hosted on External Nodes VR Clients TransiFon Across MEC LocaFon Zones Based on PoA Live Video MEC App 360° IP Camera VR Client VR Client AR UE AR UE