Skip navigation.

UCSD Computer Vision

Complex Illumination, Materials and Shadows in Computer Vision

Ravi Ramamoorthi


Synopsis

Natural illumination, realistic specular reflections, and complex cast shadows are key features in determining the appearance of objects. However, they have largely been ignored in computer vision algorithms. Our goal is to derive the theoretical foundations and mathematical equations and computational techniques to allow much more robust computer vision algorithms that can work in outdoor lighting conditions, with difficult specular objects, shadows and interreflections.

More info on: http://cseweb.ucsd.edu/~ravir/projects/vision.html


Details

Natural illumination, realistic specular reflections, and complex cast shadows are key features in determining the appearance of objects. However, they have largely been ignored in computer vision algorithms. Indeed, most algorithms assume Lambertian objects lit by a single point source, without any explicit notion of visibility. Our goal is to derive the theoretical foundations and mathematical equations and computational techniques to allow much more robust computer vision algorithms that can work in outdoor lighting conditions, with difficult specular objects, taking shadows and interreflections into account.


Related Publications

2014
Tao M., Wang T., Malik J., Ramamoorthi R., "Depth Estimation for Glossy Surfaces with Light-Field Cameras", ECCV Workshop on Light Fields for Computer Vision (L4CV), 2014. [BibTex][pdf]
2013
Gu J., Nayar S., Grinspun E., Belhumeur P., Ramamoorthi R., "Compressive Structured Light for Recovering Inhomogeneous Participating Media", IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 35, no. 3, Mar, 2013. [www] [BibTex][pdf]
Chandraker M., Bai J., Ramamoorthi R., "On Differential Photometric Reconstruction for Unknown, Isotropic BRDFs", IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 35, no. 12, pp. 2941-2955, Dec, 2013. [www] [BibTex][pdf]
Chandraker M., Reddy D., Wang Y., Ramamoorthi R., "What Object Motion Reveals About Shape with Unknown BRDF and Lighting", Computer Vision and Pattern Recognition (CVPR), pp. 2523-2530, Jun, 2013. [BibTex][pdf]
2012
Reddy D., Ramamoorthi R., Curless B., "Frequency-Space Decomposition and Acquisition of Light Transport under Spatially Varying Illumination", European Conference on Computer Vision (ECCV), pp. 6-596--6-610, Oct, 2012. [www] [BibTex][pdf]
Ng T., Pahwa R., Bai J., Tan K., Ramamoorthi R., "From the Rendering Equation to Stratified Light Transport Inversion", International Journal of Computer Vision (IJCV), vol. 96, no. 2, pp. 235-251, Feb, 2012. [www] [BibTex][pdf]
2011
Chandraker M., Bai J., Ramamoorthi R., "A Theory of Differential Photometric Stereo for Unknown Isotropic BRDFs", International Conference on Computer Vision (ICCV), pp. 1076-1083, Oct, 2011. [www] [BibTex][pdf]
Carroll R., Ramamoorthi R., Agrawala M., "Illumination Decomposition for Material Recoloring with Consistent Interreflections", ACM Transactions on Graphics (SIGGRAPH 2011), vol. 30, no. 4, pp. 43, Jul, 2011. [www] [BibTex][pdf]
Chandraker M., Bai J., Ng T., Ramamoorthi R., "On the Duality of Forward and Inverse Light Transport", IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 33, no. 10, pp. 2122-2128, Oct, 2011. [www] [BibTex][pdf]
Ramamoorthi R., "Sparse Reconstruction of Visual Appearance for Computer Graphics and Vision", SPIE Wavelets and Sparsity, Sep, 2011. [BibTex][pdf]
Chandraker M., Ramamoorthi R., "What an Image Reveals About Material Reflectance", International Conference on Computer Vision (ICCV), pp. 1076-1083, Oct, 2011. [www] [BibTex][pdf]
2010
Bai J., Chandraker M., Ng T., Ramamoorthi R., "A Dual Theory of Inverse and Forward Light Transport", European Conference on Computer Vision (ECCV), pp. 2-294--2-307, Sep, 2010. [www] [BibTex][pdf]
2009
Peers P., Mahajan D., Lamond B., Ghosh A., Matusik W., Ramamoorthi R., Debevec P., "Compressive Light Transport Sensing", ACM Transactions on Graphics, vol. 28, no. 1, Jan, 2009. [BibTex][pdf]
2008
Mahajan D., Ramamoorthi R., Curless B., "A Theory of Frequency Domain Invariants: Spherical Harmonic Identities for BRDF/Lighting Transfer and Image Consistency", IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 30, no. 2, pp. 197-213, Feb, 2008. [www] [BibTex][pdf]
Gu J., Nayar S., Grinspun E., Belhumeur P., Ramamoorthi R., "Compressive Structured Light for Recovering Inhomogeneous Participating Media", European Conference on Computer Vision (ECCV), pp. 4-845-4-858, Oct, 2008. [BibTex][pdf]
Osadchy M., Jacobs D.W., Ramamoorthi R., Tucker D., "Using Specularities in Comparing 3D Models and 2D Images", Computer Vision and Image Understanding, vol. 111, no. 3, pp. 275-294, Mar, 2008. [BibTex]
2006
Mahajan D., Ramamoorthi R., Curless B., "A Theory of Frequency Domain Invariants: Spherical Harmonic Identities of BRDF/Lighting Transfer and Image Consistency", European Conference on Computer Vision (ECCV), pp. 4-41--4-55, Oct, 2006. [www] [BibTex][pdf]
Ramamoorthi R., "Modeling Illumination Variation with Spherical Harmonics", Face Processing: Advanced Modeling and Methods, 2006. [BibTex][pdf]
Zickler T., Ramamoorthi R., Enrique S., Belhumeur P., "Reflectance-Sharing: Image-Based Rendering from a Sparse Set of Images", IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), vol. 28, no. 8, pp. 1287-1302, Aug, 2006. [BibTex][pdf]
2005
Ramamoorthi R., Koudelka M., Belhumeur P., "A Fourier Theory of Cast Shadows", A Fourier Theory for Cast Shadows, vol. 27, no. 2, pp. 288-295, Feb, 2005. [BibTex][pdf]
2004
Ramamoorthi R., Koudelka M., Belhumeur P., "A Fourier Theory for Cast Shadows", European Conference on Computer Vision (ECCV), pp. 146-162, Sep, 2004. [BibTex][pdf]
2003
Osadchy M., Jacobs D.W., Ramamoorthi R., "Using Specularities for Recognition", International Conference on Computer Vision (ICCV), pp. 1512-1519, 2003. [BibTex][pdf]
2002
Ramamoorthi R., "Analytic PCA Construction for Theoretical Analysis of Lighting Variability in Images of a Lambertian Object", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 10, pp. 1322-1333, Oct, 2002. [BibTex][pdf]
2001
Ramamoorthi R., Hanrahan P., "A Signal-Processing Framework for Inverse Rendering", SIGGRAPH, pp. 117-128, Jul, 2001. [www] [BibTex][pdf]