Recently, learning methods have been designed to create Multiplane Images (MPIs) for view synthesis. While MPIs are extremely powerful and facilitate high quality renderings, a great amount of memory is required, making them impractical for many applications. In this paper, we propose a learning method that optimizes the available memory to render compact and adaptive MPIs. Our MPIs avoid redundant information and take into account the scene geometry to determine the depth sampling.
Deep View Synthesis with Compact and Adaptive Multiplane Images
Deep View Synthesis with Compact and Adaptive Multiplane Images
Deep View Synthesis with Compact and Adaptive Multiplane Images
Research Paper / Jan 2022 / Immersive / AR/VR/MR, Light Field, Volumetric Imaging, Machine learning/ Deep learning /Artificial Intelligence
Related Content
We present a new method for reconstructing a 4D light field from a random set of measurements. A 4D light field block can be represented by a sparse model in the Fourier domain. As such, the proposed algorithm reconstructs the light field, block by block, by selecting frequencies of the model that best fits the available samples, while enforcing orthogonality wi…
Light-field (LF) is foreseen as an enabler for the next generation of 3D/AR/VR experiences. However, lack of unified representation, storage and processing formats, variant LF acquisition systems and capture-specific LF processing algorithms prevent cross-platform approaches and constrain the advancement and standardization process of the LF information. In this…
Webinar /Jun 2024
Blog Post /Jun 2025
Blog Post /Jun 2025