All Insights

In a new insight paper commissioned by InterDigital, CCS Insights details why energy efficiency is increasingly important in the video and media ecosystem, and introduces InterDigital’s cutting edge P ...

Now Buffering: How to Solve the Top Hurdles Fans Face in Streaming Live Sports explores how the shift from traditional television to digital streaming is reshaping the way fans experience live sports. ...

As live sports migrates from traditional broadcast to digital platforms, streaming is redefining how leagues, networks, and tech providers engage audiences and generate revenue. This transition brings ...

Citing findings from a recent paper written by InterDigital and Futuresource examining the environmental impact of the video ecosystem, this webinar will outline trends driving energy growth in the vi ...

A global shift in the standard of living has caused significant growth in greenhouse carbon emissions (GHG), with the TV and video streaming industry accounting for 4% of total global emissions—double ...

Haptics represent a new modality of immersive communication, infusing the sense of touch and tactile sensations to complement the visual and audio information conveyed in immersive content. Drawing in ...

Our modes of communication are evolving to empower immersive content and increasingly incorporate haptics, or the sense of touch, into our connected experiences. This new modality extends our sensory ...

In recent video coding standards, the introduction of multiple transform selection (MTS) has significantly improved coding efficiency. The latest standard, Versatile Video Coding (VVC), adopted implic ...

"Learning-based point cloud (PC) compression is a promising research avenue to reduce the transmission and storage costs for PC applications. Existing learning-based methods to compress PCs attributes ...

"The last standard Versatile Video Codec (VVC), aims to im- prove the compression efficiency by saving around 50% of bitrate at the same quality compared to its predecessor High Efficiency Video Codec ...

Live production workflows, particularly those for sports, employ complex pipelines to deliver HD, UHD, SDR, and HDR video streams. Because content originates as HDR or SDR, effective and flexible conv ...

Achieving successful variable bitrate compression with computationally simple algorithms from a single end-to-end learned image or video compression model remains a challenge. Many approaches have bee ...

The Eyelashes dataset is the first publicly available dataset of 3D eyelashes containing a total of 56 subjects.The dataset is intended to be used for evaluation, validation, or training models to pre ...

Since the standard was finalised a decade ago, HEVC has been on a slow but steady journey to become one of the leading video codecs. HEVC’s adoption may not have been as rapid as the developers of the ...

The system behind global standards, such as 5G, is one of the great commercial success stories of the modern industrial age. The process of collaboration, which brings together innovators from around ...

Extended Reality (XR) is a broad term encapsulating a spectrum of Augmented Reality (AR), Virtual Reality (VR), and Mixed Reality (MR) experiences that capture audio, video, haptic, and kinesthetic da ...

The DisplayPower2k dataset is a set of power consumption measures for different OLED screens, and pixel-wise power map images, computed from 648 images.Additional energy-aware images and their corresp ...

Video codecs play an integral, yet often underappreciated, role in digital video. Since the 1980s, they have remained a crucial but sometimes overlooked element of the software stack. The most success ...

The FilmGrainStyle740k dataset is a set of image pairs of grain-free and grainy images. Images with grain were generated from the clean images, using some proprietary plug-in in the VFX and Film Editi ...

At InterDigital, we develop foundational technologies and solutions that enable us to enhance our communications and support a diverse range of virtual experiences for an array of connected ecosystems ...

Greenhouse gas (GHG) emissions in the earth’s atmosphere have grown exponentially since the 1950s leading to damaging ecological, physical and health impacts worldwide. Seven of these GHGs contribute ...

The FilmGrain Dataset is a set of image pairs with and without film grain (grainy / grain-free) at five different film grain intensity levels.It is intended to be used for training a deep learning mod ...

5G networks will become commonplace within the next five years, expected to deliver on multiple promises of gigabit speeds, ultra-low latency, higher reliability and improved density in device connect ...

This paper presents experimentation results related to adaptive video content mapping used as compression tool of HDR-PQ content. The purpose of adaptive video content mapping is to adapt the video si ...

In this work we propose several full-color metagrating solutions for single waveguide-based Augmented and Virtual Reality near-eye display systems. The presented solutions are based on a combination o ...

Facial caricature is the art of drawing faces in an exaggerated way to convey emotions such as humor or sarcasm. Automatic caricaturization has been explored both in the 2D and 3D domain. In this pape ...

Waveguide based optical combiners for Augmented Reality (AR) glasses are integrating several Surface Relief Gratings (SRG) whose pitch sizes can be as small as 200 nm for the blue wavelength. All SRG ...

Creation of the sequences:10 sequences were created using the Unity game engine to load and play several games. We captured the frame buffers using Unity Recorder and custom post-processing shaders in ...

Based on the foundation of current video coding and distribution standards, the France-based 3EMS project funded by the Brittany Region aims to deploy the first end-to-end 5G Versatile Video Coding (V ...

In this paper we present our on-going work on light sourceestimation in room-scale scenes for more photorealistic expe-riences. Our unique input is an up-to-date textured 3D meshof a real uncontrolled ...

AI will become an essential part of our lives in the next few years, with the promise of delivering super-intelligent computers that exceed human analytical abilities. This is, however, several years ...

Despite many modern applications of Deep Neural Networks (DNNs), the large number of parameters in the hidden layers makes them unattractive for deployment on devices with storage capacity constraints ...

Recently, learning methods have been designed to create Multiplane Images (MPIs) for view synthesis. While MPIs are extremely powerful and facilitate high quality renderings, a great amount of memory ...

Deep bi-prediction blending. This paper presents a learning-based method to improve bi-prediction in video coding. In conventional video coding solutions, block-based motion compensation blocks from a ...

Film grain is often desirable feature in video production. Content creators can use film grain to create a natural appearance and to express their creative-artistic impression. With the expansion of t ...

The Long Range (LoRa) protocol for low-power wide-area networks (LPWANs) is a strong candidate to enable the massive roll-out of the Internet of Things (IoT) because of its low cost, impressive sensit ...

Representation of 3D scenes is gaining popularity in industry, notably for Virtual Reality, Augmented Reality, and 360° Video. The point cloud format is well suited for such representations. Indeed, p ...

The world has witnessed significant change since the dawn of the Industrial Revolution. Life expectancy has more than doubled; travel across the planet can happen in less than a day; loved ones can be ...

Representation of 3D scenes is gaining popularity in industry, notably for Virtual Reality, Augmented Reality, and 360° Video. The point cloud format is well suited for such representations. Indeed, p ...

This paper presents CompressAI, an open-source library that provides custom operations, layers, models and tools to research, develop, and evaluate end-to-end image and video codecs. In particular, Co ...

The Versatile Video Coding (VVC) is the most recent video coding standard jointly developed by MPEG (ISO/IEC) and VCEG (ITU-T) in the JVET (Joint Video Experts Team).The VVC Final Draft International ...

Transform and partitioning represent core components of the video coding architectures. Compared with HEVC, VVC is characterized by higher number of transform types, additional transform level (LFNST) ...

In this paper, we propose a novel interpolation of reference samples for intra prediction in Versatile Video Coding (VVC). To interpolate a predictor value between two reference samples, the method us ...

The upcoming MPEG Immersive Video (MIV) standard will enable storage and distribution of immersive video content over existing and future networks, for playback with 6 full or partial degrees of freed ...

Current video coding standards like HEVC, VP9, VVC, AV1, etc., involve partitioning a picture into coding tree units (CTU), typically corresponding to 64x64 or 128x128 picture areas. Each CTU is parti ...

Cloud gaming remains one of the mobile industry’s most exciting and highly anticipated use cases. The success of this next generation gaming method depends on low latency and high-speed data rates ove ...

Visual technologies – video, yes, but also cloud gaming, AR/VR, and immersive content – are a game of multiples: increasing numbers of users and providers, engaging with content that is ever-increasin ...

Streaming media continues to reach more areas of consumers’ daily lives and as these markets mature attention begins shifting to new opportunities; opportunities that bring additional value, but also ...

A research report by ABI Research predicts the transformation of a world where interaction with a single screen is the norm to a world of the “pervasive screen”, where multiple and various display typ ...

In contrast to existing datasets with very few video resources and limited accessibility due to copyright constraints, LIRIS-ACCEDE consists of videos with a large content diversity annotated along af ...

The LaFin: Large-scale Flickr interestingness dataset (hereafter “the Dataset”) is a collection of Flickr image IDs corresponding to about 123k Flickr images, equally balanced between interesting and ...

Automatic extraction of face tracks is a key component of systems that analyzes people in audio-visual content such as TV programs and movies. Due to the lack of annotated content of this type, popula ...

The Interestingness Dataset is a collection of movie excerpts and key-frames and their corresponding ground-truth files based on the classification into interesting and non-interesting samples. It is ...

The recent VR/AR applications require some way to evaluate the Quality of Experience (QoE) which can be described in terms of comfort, acceptability, realism, and ease of use. In order to assess all t ...

The VSD benchmark is a collection of ground-truth files based on the extraction of violent events in movies and web videos, together with high-level audio and video concepts. It is intended to be used ...

The Movie Memorability Database and related software is a collection of movie excerpts and corresponding ground-truth files based on the measurement of long-term memory performance when recognizing sm ...

The automatic recognition of human emotions is of great interest in the context of multimedia applications and brain-computer interfaces. While users’ emotions can be assessed based on questionnaires, ...

We provide a set of synchronized Light-Field video sequences captured by a 4x4 camera rig at 30fps. Each camera has a resolution of 2048x1088 pixels and a 12mm lens. The Field Of View (FOV) is 50˚ x 3 ...

The VideoMem or Video Memorability Database is a collection of sound-less video excerpts and their corresponding ground-truth memorability files. The memorability scores are computed based on the meas ...

The arrival of YouTube in 2005, followed by Apple’s first iPhone in 2007, and Google’s Android platform in 2008, serves as the preamble to what has become a two-screen video market. A decade and a hal ...

Gaël Seydoux, Research & Innovation Director at Technicolor, discusses Volumetric Technology live from the InterDigital booth at MWC19 in Barcelona. ...

Don Tian, Senior Principal Engineer at InterDigital, discusses the importance of video standards as it relates to 5G live from the InterDigital booth at MWC19 in Barcelona. ...

Volumetric content is the future generation of video that is generated by a set of multiple cameras, a Light Field Acquisition system. Join Arno Schubert, Project Manager at Technicolor Research and I ...

This joint demo of InterDigital Inc. and Technicolor Research & Innovation hosted by Jun Han, Principal Engineer at InterDigital, will showcase 360° video streaming from 13 pre-recorded camera views, ...

We present a diminished reality application running live on consumer mobile devices. In our pre-observation-based approach, the clean 3D scene, free of undesired objects, is scanned beforehand and rec ...

Check out this report detailing the State of Art (SoA) of optical hardware currently used in the field of 3D display technology, as well as emerging optical hardware technologies that feature Light Fi ...

Augmented Reality (AR) is a concept and a set of technologies for merging of real and virtual elements to produce new visualizations – typically a video – where physical and digital objects co-exist a ...

Recently, the advances in transform coding have contributed to significant bitrate saving for the next generation of video coding. In particular, the combination of different discrete trigonometric tr ...

With the growth of virtual reality setups, digital sculpting tools become more and more immersive. It is now possible to create a piece of art within a virtual environment, directly with the controlle ...

In this paper, we propose a new format for haptic texture mapping which is not dependent on the haptic rendering setup hardware. Our “haptic material” format encodes ten elementary haptic features in ...

Our work is a perceptual study into the effects of training poses on the Example-Based Facial Rigging (EBFR) method. We analyse the output of EBFR given a set of training poses to see how well the res ...

Over the last few years, we watched head-worn virtual and augmented reality devices move from research laboratories to store shelves as the newest platform enabling novel virtual experiences. The big ...

Photometric registration consists in blending real and virtual scenes in a visually coherent way. To achieve this goal, both reflectance and illumination properties must be estimated. These estimates ...

Quadrotor drones equipped with high quality cameras have rapidly raised as novel, cheap and stable devices for filmmakers. While professional drone pilots can create aesthetically pleasing videos in s ...

During MWC18, InterDigital's Yong He demonstrated an end-to-end 360 video live streaming platform with AR capabilities that is built upon a series of state-of-the-art video standards, including MPEG O ...

InterDigital's CCO Patrick Van de Wille takes us on a tour of the MWC 2018 InterDigital booth and provides insight into technology demonstrations, the InterDigital studio space, and other happenings t ...

Thanks to the increasing number of images stored in the cloud, external image similarities can be leveraged to efficiently compress images by exploiting inter-images correlations. In this paper, we pr ...

Virtual reality offers a new way of telling stories and engaging audiences. To create appealing content for this new imaging modality, content production and post-production workflows need to be adapt ...

Color grading is a crucial step in film post-production for defining the creative intent and giving a particular look and feel to the content. In the context of VR, no adapted solutions exist yet for ...

Presentation of Light Fields pipeline for Immersive Video Experiences ...

Technicolor has been investigating how Mixed Reality technology could impact the future of home entertainment. We have designed and implemented a system to extend a standard TV experience with AR cont ...

The proposed Single Layer SDR backward compatible HDR video distribution solution detailed in this paper, named SL-HDR1, and standardized in ETSI TS 103 433 specification, aims at addressing these iss ...

Augmented Reality (AR) scenarios aim to provide realistic blending between real world and virtual objects. A key factor for realistic AR is thus a correct illumination simulation. This consists in est ...

This paper describes a light field scalable compression scheme based on the sparsity of the angular Fourier transform of the light field. A subset of sub-aperture images (or views) is compressed using ...

Lighting is a key element in photography. Professional photographers often work with complex lighting setups to directly capture an image close to the targeted one. Some photographers reversed this tr ...

Recent work in video compression has shown that using multiple 2D transforms instead of a single transform in order to de-correlate residuals provides better compression efficiency. These transforms a ...

360° video, supporting the ability to present views consistent with the rotation of the viewer's head along three axes (roll, pitch, yaw) is the current approach for creation of immersive video experi ...

This paper investigates the role of the embodiment in an immersive video experience. A system allowing to play back omnidirectional videos enhanced with real-time 3D content is presented. It enables t ...

With virtual reality (VR), the goal is to create experiences in which the user can be completely immersed; an alternative reality produced by a computer simulation and displayed to the user as a compl ...

Recent years have shown significant advances in immersive media experiences. Three-dimensional representation formats allow for new forms of entertainment and communication. In this context, point clo ...

Despite the relatively recent commercial availability of consumer devices, various market forecasts are expecting a rapid increase in the number of users and the market value of augmented reality (AR) ...

At NAB 2017, Ericsson demonstrated 8K 360-degree video experience utilizing InterDigital's 8K content. Check out the demo here! ...

The human visual system (HVS) non-linearly processes light from the real world, allowing us to perceive detail over a wide range of illumination. Although models that describe this non-linearity are c ...

Summary form only given. This paper presents two sets of modifications to band offset type of the Sample Adaptive Offset technique in HEVC. First, some constraints on the SAO semantics are added to so ...

This paper presents an adaptive clipping technique with optimized syntax in the video coding Joint Exploratory Model (JEM), which exploits the signal characteristics of the video sequence. The compone ...

Immersive videos allow users to freely explore 4 π steradian scenes within head-mounted displays (HMD), leading to a strong feeling of immersion. However users may miss important elements of the narra ...

In this paper, we propose a novel scheme for scalable image coding based on the concept of epitome. An epitome can be seen as a factorized representation of an image. Focusing on spatial scalability, ...

The migration from high-definition TV to ultrahigh definition (UHD) is already underway. In addition to an increase of picture spatial resolution, UHD potentially provides more color by introducing a ...

We introduce analytic approximations for accurate real-time rendering of surfaces lit by non-occluded area light sources. Our solution leverages the Irradiance Tensors developed by Arvo for the shadin ...

Adaptive transform learning schemes have been extensively studied in the literature with a goal to achieve better compression efficiency compared to extensively used Discrete Cosine Transforms (DCT) i ...

HDR Solution presentation ...

This paper describes a novel scheme to reduce the quantization noise of compressed videos and improve the overall coding performances. The proposed scheme first consists in clustering noisy patches of ...

The acquisition of surface material properties and lighting conditions is a fundamental step for photo-realistic Augmented Reality (AR). In this paper, we present a new method for the estimation of di ...

Despite the rapid growth of wearable and mobile devices and associated availability of vibrotactile (VT) actuators, the design space of VT applications has remained primarily limited to event-based VT ...

Virtual Reality enclosures are inexpensive devices that create a virtual reality experience using a mobile phone. For example, Google Cardboard lets a user put their phone inside the device and is mad ...

This paper addresses the estimation of accurate long-term dense motion fields from videos of complex scenes. With computer vision applications such as video editing in mind, we exploit optical flows e ...

HDR Tutorial ...

Displays' new rendering capabilities combined with the ever-growing number of video applications have fueled the emergence of new video formats addressing wider color gamut and larger frame size. Thus ...

Monte-Carlo integration techniques for global illumination are popular on GPUs thanks to their massive parallel architecture, but efficient implementation remains challenging. The use of randomly deco ...

Adding the sense of touch to hearing and seeing would be necessary for a true immersive experience. This is the promise of the growing "4D-cinema" based on motion platforms and others sensory effects ...

The movie industry has been using Unmanned Aerial Vehicles as a new tool to produce more and more complex and aesthetic camera shots. However, the shooting process currently rely on manual control of ...

The movie industry has been using Unmanned Aerial Vehicles as a new tool to produce more and more complex and aesthetic camera shots. However, the shooting process currently rely on manual control of ...

The rise of Unmanned Aerial Vehicles and their increasing use in the cinema industry calls for the creation of dedicated tools. Though there is a range of techniques to automatically control drones fo ...

We present in this paper a production-oriented technique designed to visualize contact in real-time between 3D objects. The motivation of this work is to provide integrated tools in the production wor ...

With the advent of ultra-high-definition TV services, high dynamic range (HDR) and wide color gamut (WCG) have become two highly desired image quality improvements for delivering immersive video exper ...

Between the recent popularity of virtual reality (VR) and the development of 3D, immersion has become an integral part of entertainment concepts. Head-mounted Display (HMD) devices are often used to a ...

Focusing on error-correction methods and codes, a systems level design is presented for encoding movies and digital information in DNA storage. A source of data (e.g., movies, audio) is compressed, ef ...

As the video industry begins deployment of ultrahigh-definition TV in both professional and consumer markets, including support for higher dynamic range and wider color gamut services is considered es ...

Learn how the mechanics of vision can be leveraged to identify and remove details that cannot be perceived by a viewer in a specific viewing situation and much more in this Colin Dixon whitepaper. ...

An examination of the value chain that drives video is necessary to understand and examine the future of video distribution. Operators, broadcasters or platforms that either produce or aggregate conte ...