Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes



Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes

Reflectance and Illumination Estimation for Realistic Augmentations of Real Scenes
Research Paper / ISMAR 2016 / Sep 2016 / Immersive/AR/VR/MR, Computer Vision

The acquisition of surface material properties and lighting conditions is a fundamental step for photo-realistic Augmented Reality (AR). In this paper, we present a new method for the estimation of diffuse and specular reflectance properties of indoor real static scenes. Using an RGB-D sensor, we further estimate the 3D position of light sources responsible for specular phenomena and propose a novel photometry-based classification for all the 3D points. Our algorithm allows convincing AR results such as realistic virtual shadows as well as proper illumination and specularity occlusions.

Download Now


Related Content

Metagrating solutions for full color single-plate waveguide combiner
RESEARCH PAPER / Feb 2022 / Immersive/AR/VR/MR, Image Processing
In this work we propose several full-color metagrating solutions for single waveguide-based Augmented and Virtual Reality near-eye display systems. The presented solutions are based on a combination of reflective and/or transmissive diffraction gratings inside or outside a waveguide. The proposed designs have high intensity across a wide angular range. Applying...
Study on Automatic 3D Facial Caricaturization: from rules to Deep Learning
RESEARCH PAPER / Jan 2022 / Computer Graphics, Immersive/AR/VR/MR
Facial caricature is the art of drawing faces in an exaggerated way to convey emotions such as humor or sarcasm. Automatic caricaturization has been explored both in the 2D and 3D domain. In this paper, we present the first study of facial mesh caricaturization techniques. In addition to a user...
Over-wavelength pitch sized diffraction gratings for augmented reality applications
RESEARCH PAPER / Jan 2022 / Immersive/AR/VR/MR, Optics, Light Field
Waveguide based optical combiners for Augmented Reality (AR) glasses are integrating several Surface Relief Gratings (SRG) whose pitch sizes can be as small as 200 nm for the blue wavelength. All SRG components exploit the first diffraction order to couple in and out or to deviate the light. We present...
Recognizing The Importance of Global Standards
WEBINAR / Oct 2023
Defining the XR Experience
WEBINAR / Sep 2023
Defining the Evolution of Video Codecs: New Trends i...
WEBINAR / Jun 2023
Integrating Sensing and Communications: A Key Buildi...
BLOG / Nov 2023 / Posted By: Alain Mourad, Head of Wireless Lab Europe and Chair of ETSI ISAC ISG
Interns at InterDigital: Exploring Vision for Machines
BLOG / Oct 2023 / Posted By: InterDigital Comms
How Standards Promote Sustainable Innovation
BLOG / Oct 2023 / Posted By: InterDigital Comms

ready to
learn more?

CONTACT INVESTORS
InterDigital logo in white

   © COPYRIGHT 2023 INTERDIGITAL, INC. ALL RIGHTS RESERVED.