Shape from Varying Illumination and Viewpoint

 

Neel Joshi David Kriegman
UCSD UCSD

Presented at
ICCV 2007

 

Shape from varying illumination and viewpoint. One of eight views of a figurine rotating it in front of a camera and light (first image). The intermediate dense depth map recovered by our method -- red is closer and blue further from the camera (second image) and renderings of the final surface (third and fourth image).

 

Abstract

 

We address the problem of reconstructing the 3-D shape of a Lambertian surface from multiple images acquired as an object rotates under distant and possibly varying illumination. From camera projection matrices estimated from point correspondences across views, the algorithm computes a dense correspondence map by minimizing a multi-ocular photometric constraint. Once correspondence across views is established, photometric stereo is applied to estimate a surface normal field and 3-D shape. Conceptually, the algorithm merges multi-view stereo and photometric stereo and uses aspects of both methods to recover shape. The method is straightforward to implement and relies on established principles from the two stereo methods. We empirically validate the method on images of a number of objects and show that it outperforms previous methods.

 

Paper

Adobe Acrobat PDF (2.48 MB)

Poster

Adobe Acrobat PDF (3.23 MB)

Video Results

Divx (24.9 MB) | Quicktime (21.5 MB)