Abstract

Face recognition systems classically recognize people individually. When presented with a group photograph containing multiple people, such systems implicitly assume statistical independence between each detected face. We question this basic assumption and consider instead that there is a dependence between face regions from the same image; after all, the image was acquired with a single camera, under consistent lighting (distribution, direction, spectrum), camera motion, and scene/camera geometry. Such naturally occurring commonalities between face images can be exploited when recognition decisions are made jointly across the faces, rather than independently. Furthermore, when recognizing people in isolation, some features such as color are usually uninformative in unconstrained settings. But by considering pairs of people, the relative color difference provides valuable information. This paper reconsiders the independence assumption, introduces new features and methods for recognizing pairs of individuals in group photographs, and demonstrates a marked improvement when these features are used in joint decision making vs. independent decision making. While these features alone are only moderately discriminative, we combine these new features with state-of art attribute features and demonstrate effective recognition performance. Initial experiments on two datasets show promising improvements in accuracy.

Keywords

Discriminative modelArtificial intelligenceComputer scienceFacial recognition systemIndependence (probability theory)Face (sociological concept)Computer visionThree-dimensional face recognitionPattern recognition (psychology)Feature extractionMotion (physics)Face detectionMathematicsStatistics

Affiliated Institutions

Related Publications

Phylogenies and the Comparative Method

Comparative studies of the relationship between two phenotypes, or between a phenotype and an environment, are frequently carried out by invalid statistical methods. Most regres...

1985 The American Naturalist 9916 citations

Publication Info

Year
2011
Type
article
Pages
1-8
Citations
22
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

22
OpenAlex

Cite This

Ohil K. Manyam, Neeraj Kumar, Peter N. Belhumeur et al. (2011). Two faces are better than one: Face recognition in group photographs. , 1-8. https://doi.org/10.1109/ijcb.2011.6117516

Identifiers

DOI
10.1109/ijcb.2011.6117516