Reliability theory and clinical psychology

Area of Science:

• Psychometrics
• Psychological Assessment
• Measurement Theory

Background:

• Psychologists frequently disregard test reliability data when reporting results.
• Current practices rely on the standard error of measurement (SEM) to estimate true score ranges.
• Common assumptions about observed scores and SEM in psychometric textbooks are widely accepted but potentially flawed.

Purpose of the Study:

• To challenge and correct prevalent misconceptions regarding the estimation of true scores and measurement error in psychological testing.
• To present a scientifically accurate method for determining the most probable true score and its associated error range.
• To discuss the implications of these findings for psychological report writing and interpretation.

Main Methods:

• Critical analysis of established psychometric principles concerning reliability and standard error of measurement.
• Development and description of a revised procedure for estimating true scores and error bounds.
• Examination of the theoretical underpinnings of common psychometric assumptions.

Main Results:

• The study demonstrates that popular beliefs about observed scores as the best estimate of true scores are incorrect.
• It is shown that the standard error of measurement is not the standard deviation of true scores around the observed score.
• A correct procedure for estimating the most probable true score and its error range is detailed.

Conclusions:

• Current methods for estimating true scores and measurement error in psychological testing are fundamentally flawed.
• Revised procedures are necessary for accurate reporting of psychological test results.
• Adoption of corrected methods will enhance the precision and validity of psychological assessments.