Abstract

ABSTRACT This paper extends earlier work (Bradlow, Wainer, & Wang, 1999; Wainer, Bradlow, & Du, 2000) on the modeling of testlet‐based response data to include the situation in which a test is composed, partially or completely, of polytomously scored items and/or testlets. A modified version of commonly employed item response models, embedded within a fully Bayesian framework, is proposed, and inferences under the model are obtained using Markov chain Monte Carlo (MCMC) techniques. Its use is demonstrated within a designed series of simulations and by analyzing operational data from the North Carolina Test of Computer Skills and Educational Testing Service's Test of Spoken English (TSE). Our empirical findings suggest that the North Carolina Test of Computer Skills exhibits significant testlet effects, indicating significant dependence of item scores obtained from common stimuli, whereas the TSE exam does not.

Keywords

Markov chain Monte CarloItem response theoryBayesian probabilityTest (biology)Educational testingComputerized adaptive testingComputer scienceEconometricsMarkov chainMonte Carlo methodStatisticsArtificial intelligencePsychologyMathematicsMachine learningPsychometricsStandardized test

Affiliated Institutions

Related Publications

Publication Info

Year
2002
Type
article
Volume
2002
Issue
1
Citations
139
Access
Closed

External Links

Social Impact

Social media, news, blog, policy document mentions

Citation Metrics

139
OpenAlex

Cite This

Xiaohui Wang, Eric T. Bradlow, Howard Wainer (2002). A GENERAL BAYESIAN MODEL FOR TESTLETS: THEORY AND APPLICATIONS. ETS Research Report Series , 2002 (1) . https://doi.org/10.1002/j.2333-8504.2002.tb01869.x

Identifiers

DOI
10.1002/j.2333-8504.2002.tb01869.x