Related Experiment Video
Updated: Oct 12, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Response to Sijtsma and van der Ark (2015): "Conceptions of reliability revisited and practical recommendations"
Byron Gajewski1, Larry R Price, Marjorie Bott
1Byron Gajewski, PhD, is Professor of Biostatistics, Department of Biostatistics, University of Kansas Medical Center. Larry R. Price, PhD, is Professor of Psychometrics & Statistics, Department of Counseling, Leadership, Adult Education and School Psychology, College of Education, and Department of Mathematics, College of Science, and Director, Interdisciplinary Initiative for Research Design & Analysis, Texas State University, San Marcos. Marjorie Bott, RN, PhD, is Associate Professor and Associate Dean for Research, University of Kansas School of Nursing.
Sijtsma and van der Ark present a broad set of models and methods for reliability estimation, and their discussion of similarities and differences provides clear information for nurse researchers to move forward in their instrument development projects. In particular, we applaud the authors' clear exposition of the factor analytic model and its utility for providing a framework for unifying reliability and validity. However, we do not want to be constrained only to the point estimates. We also need to ascertain the uncertainty in the point estimate-usually in the form of a 95% confidence interval-or, as the Bayesians refer to, a credible interval. Another issue not discussed by Sijtsma and van der Ark is conditional standard errors of measurement along the score scale measuring latent traits or true scores. In our response, practical tools for estimating intervals and a brief discussion of conditional standard errors of measurement are presented.
Sijtsma and van der Ark present a broad set of models and methods for reliability estimation, and their discussion of similarities and differences provides clear information for nurse researchers to move forward in their instrument development projects. In particular, we applaud the authors' clear exposition of the factor analytic model and its utility for providing a framework for unifying reliability and validity. However, we do not want to be constrained only to the point estimates. We also need to ascertain the uncertainty in the point estimate-usually in the form of a 95% confidence interval-or, as the Bayesians refer to, a credible interval. Another issue not discussed by Sijtsma and van der Ark is conditional standard errors of measurement along the score scale measuring latent traits or true scores. In our response, practical tools for estimating intervals and a brief discussion of conditional standard errors of measurement are presented.
Related Concept Videos
Reliability and Validity
Random and Systematic Errors
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Random and Systematic Errors
Distribution Reliability and Automation
Theory of Attribution II: Kelley's Covariation Theory
