Abstract

This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.

Keywords

Categorical variableKappaStatisticsHomogeneity (statistics)Multivariate statisticsMathematicsStatistical hypothesis testingCohen's kappaObserver (physics)EconometricsPoisson distributionReliability (semiconductor)Type I and type II errorsMultivariate analysisComputer science

Related Publications

Observer Reliability and Agreement

Abstract The terms observer reliability and observer agreement represent different concepts. Reliability coefficients express the ability to differentiate between subjects. Agre...

2005 Encyclopedia of Biostatistics 62 citations

Some Applications of Radial Plots

Abstract A radial plot is a graphical display for comparing estimates that have differing precisions. It is a scatter plot of standardized estimates against reciprocals of stand...

1994 Journal of the American Statistical A... 75 citations

Publication Info

Year
1977
Type
article
Volume
33
Issue
1
Pages
159-159
Citations
74977
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

74977
OpenAlex

Cite This

J. Richard Landis, Gary G. Koch (1977). The Measurement of Observer Agreement for Categorical Data. Biometrics , 33 (1) , 159-159. https://doi.org/10.2307/2529310

Identifiers

DOI
10.2307/2529310