State of the Art in Computational Plenoptic Imaging
The plenoptic function is a ray-based model for light that includes the color spectrum as well as spatial,
temporal, and directional variation. Although digital light sensors have greatly evolved in the last years,
one fundamental limitation remains: all standard CCD and CMOS sensors integrate over the dimensions of the
plenoptic function as they convert photons into electrons; in the process, all visual information is irreversibly
lost, except for a two-dimensional, spatially-varying subset - the common photograph. In this state of the
art report, we review approaches that optically encode the dimensions of the plenpotic function transcending
those captured by traditional photography and reconstruct the recorded information computationally.
Projects
Gordon Wetzstein, Ivo Ihrke, Wolfgang Heidrich
In: Proceedings of CVPR 2010.
Go to project listIn: Proceedings of CVPR 2010.
Abstract
Optically multiplexed image acquisition techniques have become increasingly popular for encoding different exposures, color channels, light-fields, and other properties of light onto two-dimensional image sensors. Recently, Fourier-based multiplexing and reconstruction approaches have been introduced in order to achieve a superior light transmission of the employed modulators and better signal-to-noise characteristics of the reconstructed data.
We show in this paper that Fourier-based reconstruction approaches suffer from severe artifacts in the case of sensor saturation, i.e. when the dynamic range of the scene exceeds the capabilities of the image sensor. We analyze the problem, and propose a novel combined optical light modulation and computational reconstruction method that not only suppresses such artifacts, but also allows us to recover a wider dynamic range than existing image-space multiplexing approaches.
Project Page Video Bibtex
@InProceedings{Wetzstein:10,
author = {G. Wetzstein and I. Ihrke and W. Heidrich},
title = {{Sensor Saturation in Fourier Multiplexed Imaging}},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {Jun},
year = {2010}
}
author = {G. Wetzstein and I. Ihrke and W. Heidrich},
title = {{Sensor Saturation in Fourier Multiplexed Imaging}},
booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {Jun},
year = {2010}
}