Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes



Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes

Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes
Research Paper / ISMAR 2016 / Sep 2016 / Immersive/AR/VR/MR, Computer Vision

The acquisition of surface material properties and lighting conditions is a fundamental step for photo-realistic Augmented Reality (AR). In this paper, we present a new method for the estimation of diffuse and specular reflectance properties of indoor real static scenes. Using an RGB-D sensor, we further estimate the 3D position of light sources responsible for specular phenomena and propose a novel photometry-based classification for all the 3D points. Our algorithm allows convincing AR results such as realistic virtual shadows as well as proper illumination and specularity occlusions.

Download Now


Related Content

Metagrating solutions for full color single-plate waveguide combiner
RESEARCH PAPER / Feb 2022 / Immersive/AR/VR/MR, Image Processing
In this work we propose several full-color metagrating solutions for single waveguide-based Augmented and Virtual Reality near-eye display systems. The presented solutions are based on a combination of reflective and/or transmissive diffraction gratings inside or outside a waveguide. The proposed designs have high intensity across a wide angular range. Applying...
Study on Automatic 3D Facial Caricaturization: from rules to Deep Learning
RESEARCH PAPER / Jan 2022 / Computer Graphics, Immersive/AR/VR/MR
Facial caricature is the art of drawing faces in an exaggerated way to convey emotions such as humor or sarcasm. Automatic caricaturization has been explored both in the 2D and 3D domain. In this paper, we present the first study of facial mesh caricaturization techniques. In addition to a user...
Over-wavelength pitch sized diffraction gratings for augmented reality applications
RESEARCH PAPER / Jan 2022 / Immersive/AR/VR/MR, Optics, Light Field
Waveguide based optical combiners for Augmented Reality (AR) glasses are integrating several Surface Relief Gratings (SRG) whose pitch sizes can be as small as 200 nm for the blue wavelength. All SRG components exploit the first diffraction order to couple in and out or to deviate the light. We present...
Enabling the Technology of Tomorrow
VIDEO / Mar 2023
Unpacking the Layers of AI Impact in 5G
WEBINAR / Feb 2023
Getting tough on patent holdout – Time for solutions
WEBINAR / Dec 2022
InterDigital’s Energy Aware Media Team Awarded Best...
BLOG / May 2023 / Posted By: InterDigital Comms
InterDigital’s Chathura Sarathchandra argues the imp...
BLOG / May 2023 / Posted By: InterDigital Comms
World IP Day: Putting InterDigital’s Female Engineer...
BLOG / Apr 2023 / Posted By: InterDigital Comms

ready to
learn more?

CONTACT INVESTORS
InterDigital logo in white

   © COPYRIGHT 2023 INTERDIGITAL, INC. ALL RIGHTS RESERVED.