Skip navigation.

UCSD Computer Vision

Serge Belongie, Faculty

more info on: http://vision.ucsd.edu/~sjb


Projects


Manifold-Based Non-Rigid Structure from Motion

Weakly Supervised Object Recognition and Localization

Multiple Instance Learning (MIL) provides a framework for training a discriminative classifier from data with ambiguous labels. This framework is well suited for the task of learning object classifiers from weakly labeled image data, where only the presence of an object in an image is known,...

Locally Smooth Manifold Learning

LSML is a method for determining a warping from a point on a manifold to its neighbors on the manifold. A direct application of this method is performed on video sequences where the ways of moving on the underlying manifold are learned and then used to move within and out of the training set. The wa...

Generalized Non-metric Multidimensional Scaling

Task Specific Local Region Matching

In this project we trained a distance function for local region matching. We show that when the application is relatively constrained, using a supervised learning approach produces better results than a generic system that was tuned by hand.

Hypergraph Clustering

We consider the problem of clustering in domains where the affinity relations are not dyadic (pairwise), but rather triadic, tetradic or higher. The problem is an instance of the hypergraph partitioning problem. We propose a two-step algorithm for solving this problem. In the first step we use a nov...

Monitoring Animal Behavior

Smart Vivarium: automated monitoring of animal health and welfare.

Vision for Structural Biology

Tissue Microarray Analysis

Shape Matching

Matching with Shape Contexts and Thin-Plate Splines.



Publications


2009
Wills J., Agarwal S., Kriegman D., Belongie S., "Toward a Perceptual Space for Gloss", ACM Transactions on Graphics, to appear, 2009. [BibTex][pdf]
Babenko B., Yang M., Belongie S., "Visual Tracking with Online Multiple Instance Learning", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, 2009. [BibTex][pdf]
Rabaud V., Belongie S., "Linear Embeddings in Non-Rigid Structure From Motion", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, 2009. [BibTex][pdf]
Rabinovich A., Belongie S., "Scenes vs. Objects: a Comparative Study of Two Approaches to Context Based Recognition", International Workshop on Visual Scene Understanding (ViSU), Miami, FL, 2009. [BibTex][pdf]
Faymonville P., Wang K., Miller J., Belongie S., "CAPTCHA-based Image Labeling on the Soylent Grid", Human Computation Workshop (HCOMP), Paris, France, 2009. [BibTex][pdfpdf]
Dollár P., Tu Z., Perona P., Belongie S., "Integral Channel Features", British Machine Vision Conference (BMVC), London, England, 2009. [BibTex][pdf]
Babenko B., Yang M., Belongie S., "A Family of Online Boosting Algorithms", Online Learning for Computer Vision (OLCV), Kyoto, 2009. [BibTex][pdf]
Babenko B., Branson S., Belongie S., "Similarity Functions for Categorization: from Monolithic to Category Specific ", International Conference on Computer Vision (ICCV), Kyoto, Japan, 2009. [BibTex][pdf]
Galleguillos C., Faymonville P., Belongie S., "BUBL: An Effective Region Labeling Tool Using a Hexagonal Lattice", Workshop on Emergent Issues in Large Amounts of Visual Data , Kyoto, Japan, 2009. [BibTex]
Venkata S., Ahn I., Jeon ., Gupta A., Louie C., Garcia S., Belongie S., Taylor M., "SD-VBS: The San Diego Vision Benchmark Suite", IEEE International Symposium on Workload Characterization (IISWC), Austin, TX, 2009. [BibTex]
Babenko B., Dollár P., Belongie S., Multiple Instance Learning with Query Bags, , 2009. [BibTex][pdf]
Fakourfar H., Belongie S., "Fingerprint Recognition System Performance in the Maritime Environment", Workshop on Applications of Computer Vision (WACV), Snowbird, UT, 2009. [BibTex][pdf]
Chandraker M., Agarwal S., Kriegman D., Belongie S., "Globally Optimal Algorithms for Stratified Autocalibration", International Journal of Computer Vision (IJCV), no. to appear, 2009. [BibTex]
2008
Koch M., Maltz J., Belongie S., Gangadharan B., Bose S., Bani-Hashemi A., "Automatic coregistration of volumetric images based on implanted fiducial markers", Medical Physics, vol. 35, no. 10, pp. 4513-23, October, 2008. [BibTex]
Galleguillos C., Belongie S., "Context Based Object Categorization: A Critical Survey", Technical Report CSE UCSD, no. CS2008-092, 08/2008. [BibTex][pdf]
Dollár P., Babenko B., Perona P., Belongie S., Tu Z., "Multiple Component Learning for Object Detection", European Conference on Computer Vision (ECCV), 2008. [BibTex][pdf]
Rabaud V., Belongie S., "Re-Thinking Non-Rigid Structure From Motion", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008. [BibTex][pdf]
Babenko B., Dollár P., Tu Z., Belongie S., "Simultaneous Learning and Alignment: Multi-Instance and Multi-Pose Learning", RealFaces, Marseille, France, 2008. [BibTex][pdf]
Galleguillos C., Babenko B., Rabinovich A., Belongie S., "Weakly Supervised Object Recognition and Localization with Stable Segmentations", European Conference on Computer Vision (ECCV), Marseille, France, 2008. [BibTex][pdf]
Galleguillos C., Rabinovich A., Belongie S., "Object Categorization using Co-Occurrence, Location and Appearance", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Anchorage, AK, 2008. [BibTex][pdf]
Koch M., Maltz J., Gangadharan B., Bose S., Shukla H., Bani-Hashemi A., Belongie S., "Automatic Co-registration of Volumetric Datasets Based on Prostate Seed Fiducial Markers", ISBI, Paris, France, 2008. [BibTex]
Kahl F., Agarwal S., Chandraker M., Kriegman D., Belongie S., "Practical Global Optimization for Multiview Geometry", IJCV, vol. 79, no. 3, pp. 271-284, 2008. [BibTex][pdf]
2007
Dollár P., Rabaud V., Belongie S., "Non-Isometric Manifold Learning: Analysis and an Algorithm", International Conference On Machine Learning (ICML), June, 2007. [BibTex][pdf]
Dollár P., Rabaud V., Belongie S., "Learning to Traverse Image Manifolds", Tech Report, no. CS2007-087: UCSD CSE, 2007. [BibTex][pdf]
Steinbach S., Rabaud V., Belongie S., "Soylent Grid: it's Made of People!", Workshop on Interactive Computer Vision (ICV), Rio de Janeiro, 2007. [BibTex][pdf]
Dollár P., Tu Z., Tao H., Belongie S., "Feature Mining For Image Classification", CVPR, 2007. [BibTex][pdf]
Rabinovich A., Vedaldi A., Galleguillos C., Wiewiora E., Belongie S., "Objects in Context", ICCV, Rio de Janeiro, 2007. [BibTex][pdf]
Rabinovich A., Vedaldi A., Belongie S., "Does Image Segmentation Improve Object Categorization?", UCSD CSE Technical Report, no. CS2007-090, 2007. [BibTex][pdf]
Babenko B., Dollár P., Belongie S., "Task Specific Local Region Matching", ICCV, Rio de Janeiro, 2007. [BibTex][pdf]
Merler M., Galleguillos C., Belongie S., "Recognizing Groceries in situ Using in vitro Training Data", SLAM, Minneapolis, MN, 2007. [BibTex][pdf]
Agarwal S., Wills J., Cayton L., Lanckriet G., Kriegman D., Belongie S., "Generalized Non-metric Multidimensional Scaling", AISTATS, San Juan, Puerto Rico, 2007. [BibTex][pdf]
Chandraker M., Agarwal S., Kriegman D., Belongie S., "Globally Optimal Affine and Metric Upgrades in Stratified Autocalibration", ICCV, 2007. [BibTex]
2006
Wills J., Agarwal S., Belongie S., "A Feature-based Approach for Dense Segmentation and Estimation of Large Disparity Motion", International Journal of Computer Vision (IJCV), vol. 68, no. 2, pp. 125-143, June, 2006. [BibTex][pdf]
Dollár P., Rabaud V., Belongie S., "Learning to Traverse Image Manifolds", Neural Information Processing Systems Conference (NIPS), Dec., 2006. [BibTex][pdf]
Rabinovich A., Krajewski S., Krajewska M., Shabaik A., Hewitt S.M., Belongie S., Reed J.C., Price J.H., "Automated Scanning and Display of Tissue Microarrays", IEEE Transactions on Information Technology in Biomedicine, vol. 10, no. 12, pp. 209-219, April, 2006. [BibTex][pdf]
Agarwal S., Branson K., Belongie S., "Higher-Order Learning with Graphs", International Conference On Machine Learning (ICML), Pittsburgh, PA, 2006. [BibTex][pdf]
Hewitt R., Belongie S., "Active Learning in Face Recognition: Using Tracking to Build a Face Model", V4HCI, New York City, 2006. [BibTex][pdf]
Ben-Haim N., Babenko B., Belongie S., "Improving Web-based Image Search via Content Based Clustering", SLAM, New York City, 2006. [BibTex][pdf]
Rabaud V., Belongie S., "Counting Crowded Moving Objects", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York City, 2006. [BibTex][pdf]
Dollár P., Tu Z., Belongie S., "Supervised Learning of Edges and Object Boundaries", CVPR, New York City, 2006. [BibTex][pdf]
Rabinovich A., Lange T., Buhmann J., Belongie S., "Model Order Selection and Cue Combination for Image Segmentation", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York City, 2006. [BibTex][pdf]
Mallick S., Agarwal S., Kriegman D., Belongie S., Carragher B., Potter C., "Structure and View Estimation for Tomographic Reconstruction: A Bayesian Approach", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), New York City, 2006. [BibTex][pdf]
Ochoa B., Belongie S., "Covariance Propagation for Guided Matching", SMVP, Graz, Austria, 2006. [BibTex][pdf]
Agarwal S., Chandraker M., Kahl F., Kriegman D., Belongie S., "Practical Global Optimization for Multiview Geometry ", European Conference on Computer Vision (ECCV), vol. 1, Graz, Austria, pp. 592-605, 2006. [BibTex][pdf]
2005
Mori G., Belongie S., Malik J., "Efficient Shape Matching Using Shape Contexts", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1832-1837, November, 2005. [BibTex]
Branson K., Belongie S., "Tracking Multiple Mouse Contours (Without Too Many Samples)", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Diego, CA, June, 2005. [BibTex]
Kumar S., Biswas M., Belongie S., Nguyen T., "Spatio-temporal texture synthesis and image inpainting for video applications", ICIP, vol. 2, Genova, Italy, pp. 85-88, 2005. [BibTex]
Belongie S., Branson K., Dollár P., Rabaud V., "Monitoring Animal Behavior in the Smart Vivarium", Measuring Behavior, Wageningen, NL, pp. 70-72, 2005. [BibTex][pdf]
Belongie S., Mori G., Malik J., "Matching with Shape Contexts", Analysis and Statistics of Shapes: Birkhäuser, 2005. [BibTex]
Laptev I., Belongie S., Pérez P., Wills J., "Periodic Motion Detection and Segmentation via Approximate Sequence Alignment", ICCV, vol. 1, Beijing, China, pp. 816-823, 2005. [BibTex]
Dlagnekov L., Belongie S., "Recognizing Cars", UCSD CSE Tech Report, no. CS2005-083, 2005. [BibTex]
Maschion M., Rabaud V., Belongie S., Computer Vision: Fact and Fiction, : UCSD/Calit2, 2005. [BibTex]
Dollár P., Rabaud V., Cottrell G., Belongie S., "Behavior Recognition via Sparse Spatio-Temporal Features", IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), Beijing, China, 2005. [BibTex][pdf]
Rabaud V., Belongie S., "Big Little Icons", Computer Vision Applications for the Visually Impaired (CVAVI), San Diego, CA, 2005. [BibTex][pdf]
Agarwal S., Lim J., Zelnik-Manor L., Perona P., Kriegman D., Belongie S., "Beyond Pairwise Clustering", CVPR, vol. 2, San Diego, CA, pp. 838-845, 2005. [BibTex]
2004
Gamio J., Belongie S., Majumdar S., "Normalized Cuts in 3D for Spinal MRI Segmentation", IEEE Transactions on Medical Imaging, vol. 23, no. 1, pp. 36-44, January, 2004. [BibTex]
Fowlkes C., Belongie S., Chung F., Malik J., "Spectral Grouping Using the Nyström Method", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 214-225, Feburary, 2004. [BibTex][pdf]
Belongie S., Wills J., "Structure from Periodic Motion", Workshop on Spatial Coherence for Visual Motion Analysis (SCVMA), Prague, Czech Republic, Springer Verlag, 2004. [BibTex]
Wills J., Belongie S., "A Feature-based Approach for Determining Dense Long Range Correspondences", European Conference on Computer Vision (ECCV), Prague, Czech Republic, Springer Verlag, 2004. [BibTex]
Agarwal S., Mallick S., Kriegman D., Belongie S., "On Refractive Optical Flow", ECCV, Prague, Czech Republic, Springer Verlag, 2004. [BibTex]
2003
Branson K., Rabaud V., Belongie S., "Three Brown Mice: See How They Run", IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), Nice, France, October, 2003. [BibTex][pdf]
Wills J., Agarwal S., Belongie S., "What Went Where", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, Madison, WI, pp. 37-44, 2003. [BibTex]
Agarwal S., Belongie S., "Segmentation by Example", Technical Report, no. CS2003-076: UCSD, 2003. [BibTex]
Agarwal S., Ramamoorthi R., Belongie S., Jensen H., "Structured Importance Sampling of Environment Maps", SIGGRAPH, San Diego, CA, 2003. [BibTex]
Rabinovich A., Agarwal S., Laris C., Price J., Belongie S., "Unsupervised Spectral Decomposition of Histologically Stained Tissue Samples", NIPS, Vancouver, BC, 2003. [BibTex]
2002
Carson C., Belongie S., Greenspan H., Malik J., Blobworld: Color- and Texture-Based Image Segmentation Using EM and Its Application to Image Querying and Classification, , vol. 24, no. 8, pp. 1026-1038, August, 2002. [BibTex]
Belongie S., Malik J., Puzicha J., "Shape Matching and Object Recognition Using Shape Contexts", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, April, 2002. [BibTex]
Belongie S., Fowlkes C., Chung F R K., Malik J., "Spectral Partitioning with Indefinite Kernels using the Nyström Extension", ECCV, Copenhagen, Denmark, Springer Verlag, 2002. [BibTex]
Agarwal S., Belongie S., "On the Non-Optimality of Four Color Coding of Image Partitions", ICIP, vol. 2, pp. 677-680, 2002. [BibTex]
Donato G., Belongie S., "Approximate Thin Plate Spline Mappings", ECCV, vol. 2, Copenhagen, Denmark, Springer Verlag, pp. 531-542, 2002. [BibTex]
Gamio J., Belongie S., Majumdar S., "Normalized Cuts for Spinal MRI Segmentation", CARS, Paris, France, 2002. [BibTex]
Fowlkes C., Shan Q., Belongie S., Malik J., "Extracting Global Structure from Gene Expression Profiles", Methods of Microarray Data Analysis II: Kluwer Academic, 2002. [BibTex]
2001
Malik J., Belongie S., Leung T., Shi J., "Contour and Texture Analysis for Image Segmentation", IJCV, vol. 43, no. 1, pp. 7-27, June, 2001. [BibTex]
Belongie S., Malik J., Puzicha J., "Matching Shapes", ICCV, vol. 1, pp. 454-461, July, 2001. [BibTex]
Fowlkes C., Belongie S., Malik J., "Efficient Spatiotemporal Grouping Using the Nyström Method", CVPR, December, 2001. [BibTex]
Mori G., Belongie S., Malik J., "Shape Contexts Enable Efficient Retrieval of Similar Shapes", CVPR, December, 2001. [BibTex]
Fowlkes C., Shan Q., Belongie S., Malik J., "Extracting Global Structure from Gene Expression Profiles", CAMDA, Durham, NC, 2001. [BibTex]
2000
Belongie S., Malik J., Puzicha J., "Shape Context: A new descriptor for shape matching and object recognition", Neural Information Processing Systems Conference (NIPS), pp. 831-837, December, 2000. [BibTex]
Belongie S., Malik J., "Matching with Shape Contexts", Content-based Access of Image and Video Libraries (CBAIVL), Hilton Head, SC, pp. 20-26, 2000. [BibTex]
Puzicha J., Belongie S., "Model-based Halftoning for Color Image Segmentation", International Conference on Pattern Recognition (ICPR), vol. 3, Barcelona, Spain, pp. 629-632, 2000. [BibTex]
Malik J., Belongie S., Leung T., Shi J., "Contour and Texture Analysis for Image Segmentation", Perceptual Organization for Artificial Vision Systems: Kluwer Academic, 2000. [BibTex]
1999
Malik J., Belongie S., Shi J., Leung T., "Textons, Contours and Regions: Cue Integration in Image Segmentation", IEEE International Conference on Computer Vision (ICCV), pp. 918-925, 1999. [BibTex]
Carson C., Thomas M., Belongie S., Hellerstein J.M., Malik J., "Blobworld: A system for region-based image indexing and retrieval", VISUAL, Amsterdam, pp. 509–516, 1999. [BibTex]
Manjunath B S., Deng Y., Forsyth D A., Carson C., Ioffe S., Belongie S., Malik J., Ma W - Y., Puri A., Chen T., "Image retrieval in digital libraries", Multimedia: Standards, Systems and Networks: Marcel Dekker, 1999. [BibTex]
Malik J., Shi J., Belongie S., Leung T., "Grouping in the Normalized Cut Framework", Shape, Contour and Grouping in Computer Vision, vol. LNCS 1681: Springer Verlag, pp. 155-164, 1999. [BibTex]
1998
Belongie S., Malik J., "Finding Boundaries in Natural Images: A New Method Using Point Descriptors and Area Completion", European Conference on Computer Vision (ECCV), Freiburg, Germany, June, 1998. [BibTex]
Belongie S., Carson C., Greenspan H., Malik J., "Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval", IEEE International Conference on Computer Vision (ICCV), pp. 675–682, 1998. [BibTex]
Shi J., Belongie S., Leung T., Malik J., "Image and Video Segmentation: The Normalized Cut Framework", International Conference on Image Processing (ICIP), vol. 1, Chicago, IL, pp. 943-947, 1998. [BibTex]
1997
Carson C., Belongie S., Greenspan H., Malik J., "Region-Based Image Querying", Content-based Access of Image and Video Libraries (CBAIVL), Puerto Rico, pp. 42-49, 1997. [BibTex]
Belongie S., Carson C., Greenspan H., Malik J., "Recognition of Images in Large Databases Using a Learning Framework", UC Berkeley CS Tech Report , no. 97-939, 1997. [BibTex]
1996
Malik J., Forsyth D., Fleck M., Greenspan H., Leung T., Carson C., Belongie S., Bregler C., "Finding Objects in Image Databases by Grouping", International Conference on Image Processing (ICIP), vol. 2, pp. 761-764, 1996. [BibTex][pdf]
Forsyth D., Malik J., Fleck M., Greenspan H., Leung T., Belongie S., Carson C., Bregler C., "Finding Pictures of Objects in Large Collections of Images", ECCV '96 International Workshop on Object Recognition for Computer Vision, Cambridge, England, pp. 335-360, 1996. [BibTex]
Belongie S., Blasi R., Murphy K., "Grouping of Color and Texture Features for Automated Image Annotation", Technical Report for CS280: U.C. Berkeley, 1996. [BibTex]
1994
Greenspan H., Belongie S., Perona P., Goodman R., Rakshit S., Anderson C., "Overcomplete Steerable Pyramid Filters and Rotation Invariance", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 222-228, 1994. [BibTex][pdf]
Greenspan H., Belongie S., Perona P., Goodman R., "Rotation Invariant Texture Recognition Using a Steerable Pyramid", International Conference on Pattern Recognition (ICPR), vol. 2, pp. 162-167, 1994. [BibTex][pdf]