High Performance Imaging Using Large Camera Arrays

 

Bennett Wilburn

Neel Joshi

Vaibhav Vaish

Eino-Ville Talvala

Emilio Antunez

Adam Barth

Andrew Adams

Mark Horowitz

Marc Levoy

 

In ACM Transactions on Graphics, Vol 24, No 3, July 2005, pp. 765-776 (Proceedings of ACM SIGGRAPH 2005).

 

Tightly packed cameras with splayed fields of view for high resolution, high dynamic range video capture.

Shared fields of view for high-speed or synthetic aperture videography.

The entire array: camera tiles, processing boards, and the four PCs required to run the system.

 

Abstract

The advent of inexpensive digital image sensors, and the ability to create photographs that combine information from a number of sensed images, is changing the way we think about photography. In this paper, we describe a unique array of 100 custom video cameras that we have built, and we summarize our experiences using this array in a range of imaging applications. Our goal was to explore the capabilities of a system that would be inexpensive to produce in the future. With this in mind, we used simple cameras, lenses, and mountings, and we assumed that processing large numbers of images would eventually be easy and cheap. The applications we have explored include approximating a conventional single center of projection video camera with high performance along one or more axes, such as resolution, dynamic range, frame rate, and/or large aperture, and using multiple cameras to approximate a video camera with a large synthetic aperture. This permits us to capture a video light field, to which we can apply spatiotemporal view interpolation algorithms in order to digitally simulate time dilation and camera motion. It also permits us to create video sequences using custom non-uniform synthetic apertures.

 

Paper

Adobe Acrobat PDF (13MB)

 

Videos

CameraArray.mp4 (70MB)

Applications of the array: high-speed imaging; high-resolution, high dynamic range video mosaics; spatiotemporal view interpolation; real-time, live synthetic aperture photography, and non-linear synthetic aperture photograpy.