In recent years, we have seen the development of integrated plenoptic sensors, where multiple pixels are placed under one microlens. It is mainly used by cameras and smartphones to drive the autofocus of the main lens, and it often takes the form of dual-pixels with 2 rectangular sub-pixels. We study the evolution of dual-pixels, the so-called quad-pixel sensor with 2x2 square sub-pixels under the microlens. As it is a simple light field capturing device, we investigate the computational photography abilities of such sensor. We first present our work on pixel-level simulations, then we present a model of image formation taking into account the diffraction by the microlens. Finally, we present new ways to process a quad-pixel images based on deep learning.
Deep learning applied to quad pixel plenoptic sensor
Deep learning applied to quad pixel plenoptic sensor
Deep learning applied to quad pixel plenoptic sensor
Research Paper / Sep 2021 / Optics, Machine learning/ Deep learning /Artificial Intelligence, Image processing
Related Content
This chapter presents the Integrated Lens Antenna (ILA) technology as it evolved since its introduction aiming to respond to the needs of emerging applications such as high-data-rate communication, intelligent transport, and mm-wave imaging. The topics covered include the ILA design concepts as well as the electromagnetic phenomena intrinsic to dielectric lenses…
Research Paper /Feb 2024 / Wireless communication, 5G, Machine learning/ Deep learning /Artificial Intelligence
The ubiquitous deployment of 4G/5G technology has made it a critical infrastructure for society that will facilitate the delivery and adoption of emerging applications and use cases (extended reality, automation, robotics, to name but a few). These new applications require high throughput and low latency in both uplink and downlink for optimal performance, while…
Research Paper /Apr 2024 / Compression, Volumetric Imaging, Machine learning/ Deep learning /Artificial Intelligence
"Learning-based point cloud (PC) compression is a promising research avenue to reduce the transmission and storage costs for PC applications. Existing learning-based methods to compress PCs attributes employ variational autoencoders (VAE) or normalizing flows (NF) to learn compact signal representations. However, VAEs leverage a lower-dimensional bottleneck that…
Webinar /Jun 2024
Blog Post /Jul 2025
Blog Post /Jun 2025
Blog Post /Jun 2025