Abstract

Aiming towards the development of a general clustering theory, we discuss abstract axiomatization for clustering. In this respect, we follow up on the work of Kleinberg, ([1]) that showed an impossibility result for such axiomatization. We argue that an impossibility result is not an inherent feature of clustering, but rather, to a large extent, it is an artifact of the specific formalism used in [1]. As opposed to previous work focusing on clustering functions, we propose to address clustering quality measures as the object to be axiomatized. We show that principles like those formulated in Kleinberg's axioms can be readily expressed in the latter framework without leading to inconsistency. A clustering-quality measure (CQM) is a function that, given a data set and its partition into clusters, returns a non-negative real number representing how strong or conclusive the clustering is. We analyze what clustering-quality measures should look like and introduce a set of requirements (axioms) for such measures. Our axioms capture the principles expressed by Kleinberg's axioms while retaining consistency. We propose several natural clustering quality measures, all satisfying the proposed axioms. In addition, we analyze the computational complexity of evaluating the quality of a given clustering and show that, for the proposed CQMs, it can be computed in polynomial time.

Keywords

Cluster analysisAxiomImpossibilityConstrained clusteringComputer scienceCorrelation clusteringTheoretical computer scienceFuzzy clusteringData miningMathematicsSet (abstract data type)CURE data clustering algorithmArtificial intelligence

Affiliated Institutions

Related Publications

On clusterings

We motivate and develop a natural bicriteria measure for assessing the quality of a clustering that avoids the drawbacks of existing measures. A simple recursive heuristic is sh...

2004 Journal of the ACM 842 citations

Publication Info

Year
2008
Type
article
Volume
21
Pages
121-128
Citations
140
Access
Closed

External Links

Citation Metrics

140
OpenAlex

Cite This

Shai Ben-David, Margareta Ackerman (2008). Measures of Clustering Quality: A Working Set of Axioms for Clustering. Neural Information Processing Systems , 21 , 121-128.