We present a novel learning-based approach to synthesize new views of a light field image. In particular, given the four corner views of a light field, the presented method estimates any in-between view. We use three sequential convolutional neural networks for feature extraction, scene geometry estimation and view selection. Compared to state-of-the-art approaches, in order to handle occlusions we propose to estimate a different disparity map per view. Jointly with the view selection network, this strategy shows to be the most important to have proper reconstructions near object boundaries. Ablation studies and comparison against the state of the art on Lytro light fields show the superior performance of the proposed method. Furthermore, the method is adapted and tested on light fields with wide baselines acquired with a camera array and, in spite of having to deal with large occluded areas, the proposed approach yields very promising results.
Learning Occlusion-Aware View Synthesis for Light Fields
Learning Occlusion-Aware View Synthesis for Light Fields
Learning Occlusion-Aware View Synthesis for Light Fields
Research Paper / Dec 2020 / Volumetric Imaging, Machine learning/ Deep learning /Artificial Intelligence
Related Content
Research Paper /Dec 2020 / Volumetric Imaging, Machine learning/ Deep learning /Artificial Intelligence
We present a novel learning-based approach to synthesize new views of a light field image. In particular, given the four corner views of a light field, the presented method estimates any in-between view. We use three sequential convolutional neural networks for feature extraction, scene geometry estimation and view selection. Compared to state-of-the-art approac…
White Paper /May 2025
Media over Wireless: Networks for Ubiquitous Video
Research Paper /Mar 2025
To realize the objectives of Integrated Sensing and
Communication (ISAC) in 6G, there is a need to introduce
new functionalities in 6G core (6GC) architecture that are
dynamic and resource-efficient. In ISAC, sensing signals are used by a Sensing Receiver (SRx) to measure and report Sensing Data Points (SDPs) to the network. However, a direct approach involving …
Webinar /Jun 2024
Blog Post /Jun 2025
Blog Post /Jun 2025