Abstract
Abstract This paper discusses a generalized version of the concordance correlation coefficient for agreement data. The concordance correlation coefficient evaluates the accuracy and precision between two measures, and is based on the expected value of the squared function of distance. We have generalized this coefficient by applying alternative functions of distance to produce more robust versions of the concordance correlation coefficient. In this paper we extend the application of this class of estimators to categorical data as well, and demonstrate similarities to the kappa and weighted kappa statistics. We also introduce a stratified concordance correlation coefficient which adjusts for explanatory factors, and an extended concordance correlation coefficient which measures agreement among more than two responses. With these extensions, the generalized concordance correlation coefficient provides a unifying approach to assessing agreement among two or more measures that are either continuous or categorical in scale. Copyright © 2001 John Wiley & Sons, Ltd.
Keywords
Affiliated Institutions
Related Publications
The Measurement of Observer Agreement for Categorical Data
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially invo...
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Contents: Preface. Introduction. Bivariate Correlation and Regression. Multiple Regression/Correlation With Two or More Independent Variables. Data Visualization, Exploration, a...
Measuring Agreement between Two Judges on the Presence or Absence of a Trait
At least a dozen indexes have been proposed for measuring agreement between two judges on a categorical scale. Using the binary (positive-negative) case as a model, this paper p...
Understanding interobserver agreement: the kappa statistic.
Items such as physical exam findings, radiographic interpretations, or other diagnostic tests often rely on some degree of subjective interpretation by observers. Studies that m...
MOMENTS OF THE STATISTICS KAPPA AND WEIGHTED KAPPA
This paper considers the mean and variance of the two statistics, kappa and weighted kappa, which are useful in measuring agreement between two raters, in the situation where th...
Publication Info
- Year
- 2001
- Type
- article
- Volume
- 20
- Issue
- 14
- Pages
- 2131-2147
- Citations
- 165
- Access
- Closed
External Links
Social Impact
Social media, news, blog, policy document mentions
Citation Metrics
Cite This
Identifiers
- DOI
- 10.1002/sim.845