Synchronization and Rolling Shutter Compensation for Consumer Video Camera Arrays
Two major obstacles to the use of consumer camcorders in computer vision applications are the lack of synchronization hardware, and the use of a "rolling" shutter, which introduces a temporal shear in the video volume. We present two simple approaches for solving both the rolling shutter shear and the synchronization problem at the same time. The first approach is based on strobe illumination, while the second employs a subframe warp along optical flow vectors. In our experiments we have used the proposed methods to effectively remove temporal shear, and synchronize up to 16 consumer-grade camcorders in multiple geometric configurations.
Projects
Matthias Hullin, Martin Fuchs, Ivo Ihrke, Hans-Peter Seidel, Hendrik P. A. Lensch
In: Proceedings of SIGGRAPH 2008.
Go to project listIn: Proceedings of SIGGRAPH 2008.
Abstract
The quality of a 3D range scan should not depend on the surface
properties of the object. Most active range scanning techniques,
however, assume a diffuse reflector to allow for a robust detection
of incident light patterns. In our approach we embed the object into
a fluorescent liquid. By analyzing the light rays that become visible
due to fluorescence rather than analyzing their reflections off the
surface, we can detect the intersection points between the projected
laser sheet and the object surface for a wide range of different materials. For transparent objects we can even directly depict a slice
through the object in just one image by matching its refractive index
to the one of the embedding liquid. This enables a direct sampling
of the object geometry without the need for computational reconstruction. This way, a high-resolution 3D volume can be assembled
simply by sweeping a laser plane through the object. We demonstrate the effectiveness of our light sheet range scanning approach
on a set of objects manufactured from a variety of materials and
material mixes, including dark, translucent and transparent objects.
Project Page Video Data Set Bibtex
@article{Hullin:2008:FIRS,
title = "Fluorescent Immersion Range Scanning",
author = "Matthias B. Hullin and Martin Fuchs and Ivo Ihrke and Hans-Peter Seidel and
Hendrik P. A. Lensch",
journal = "ACM Transactions on Graphics",
volume = 27,
number = 3,
month = aug,
year = 2008,
pages = "87:1--87:10",
}
title = "Fluorescent Immersion Range Scanning",
author = "Matthias B. Hullin and Martin Fuchs and Ivo Ihrke and Hans-Peter Seidel and
Hendrik P. A. Lensch",
journal = "ACM Transactions on Graphics",
volume = 27,
number = 3,
month = aug,
year = 2008,
pages = "87:1--87:10",
}