Abstract

We present a novel approach to measuring similarity between shapes and exploit it for object recognition. In our framework, the measurement of similarity is preceded by: (1) solving for correspondences between points on the two shapes; (2) using the correspondences to estimate an aligning transform. In order to solve the correspondence problem, we attach a descriptor, the shape context, to each point. The shape context at a reference point captures the distribution of the remaining points relative to it, thus offering a globally discriminative characterization. Corresponding points on two similar shapes will have similar shape contexts, enabling us to solve for correspondences as an optimal assignment problem. Given the point correspondences, we estimate the transformation that best aligns the two shapes; regularized thin-plate splines provide a flexible class of transformation maps for this purpose. The dissimilarity between the two shapes is computed as a sum of matching errors between corresponding points, together with a term measuring the magnitude of the aligning transform. We treat recognition in a nearest-neighbor classification framework as the problem of finding the stored prototype shape that is maximally similar to that in the image. Results are presented for silhouettes, trademarks, handwritten digits, and the COIL data set.

Keywords

Shape contextDiscriminative modelArtificial intelligencePattern recognition (psychology)Shape analysis (program analysis)Matching (statistics)Transformation (genetics)Active shape modelPoint distribution modelCognitive neuroscience of visual object recognitionContext (archaeology)Point set registrationMathematicsSimilarity (geometry)Computer visionPoint (geometry)Computer scienceHeat kernel signatureSet (abstract data type)k-nearest neighbors algorithmObject (grammar)Image (mathematics)GeometrySegmentation

Affiliated Institutions

Related Publications

Publication Info

Year
2002
Type
article
Volume
24
Issue
4
Pages
509-522
Citations
6267
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

6267
OpenAlex

Cite This

Serge Belongie, Jitendra Malik, Jan Puzicha (2002). Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence , 24 (4) , 509-522. https://doi.org/10.1109/34.993558

Identifiers

DOI
10.1109/34.993558