Categories
Nevin Manimala Statistics

Using Item Scores and Response Times to Detect Item Compromise in Computerized Adaptive Testing

Educ Psychol Meas. 2025 Sep 14:00131644251368335. doi: 10.1177/00131644251368335. Online ahead of print.

ABSTRACT

Sequential procedures have been shown to be effective methods for real-time detection of compromised items in computerized adaptive testing. In this study, we propose three item response theory-based sequential procedures that involve the use of item scores and response times (RTs). The first procedure requires that either the score-based statistic or the RT-based statistic be extreme, the second procedure requires that both the score-based statistic and the RT-based statistic be extreme, and the third procedure requires that a combined score and RT-based statistic be extreme. Results suggest that the third procedure is the most promising, providing a reasonable balance between the false-positive rate and the true-positive rate while also producing relatively short lag times across a wide range of simulation conditions.

PMID:40959735 | PMC:PMC12433998 | DOI:10.1177/00131644251368335

By Nevin Manimala

Portfolio Website for Nevin Manimala