Categories
Nevin Manimala Statistics

Adapting the multilevel model for estimation of the reliable change index (RCI) with multiple timepoints and multiple sources of error

Int J Methods Psychiatr Res. 2022 Feb 7:e1906. doi: 10.1002/mpr.1906. Online ahead of print.

ABSTRACT

OBJECTIVE: One of the primary tools in the assessment of individual-level patient outcomes is Jacobson and Truax, (1991’s) Reliable Change Index (RCI). Recent efforts to optimize the RCI have revolved around three issues: (a) extending the RCI beyond two timepoints, (b) estimating the RCI using scale scores from item response theory or factor analysis and (c) estimation of person- and time-specific standard errors of measurement.

METHOD: We present an adaptation of a two-stage procedure, a measurement error-corrected multilevel model, as a tool for RCI estimation (with accompanying Statistical Analysis System syntax). Using DASS-21 data from a community-based mental health center (N = 379), we illustrate the potential for the model as unifying framework for simultaneously addressing all three limitations in modeling individual-level RCI estimates.

RESULTS: Compared to the optimal-fitting RCI model (moderated nonlinear factor analysis scoring with measurement error correction), an RCI model that uses DASS-21 total scores produced errors in RCI inferences in 50.8% of patients; this was largely driven by overestimation of the proportion of patients with statistically significant improvement.

CONCLUSION: Estimation of the RCI can now be enhanced by the use of latent variables, person- and time-specific measurement errors, and multiple timepoints.

PMID:35132724 | DOI:10.1002/mpr.1906

By Nevin Manimala

Portfolio Website for Nevin Manimala