A Comment on Test Validation: The Importance of the Clinical Perspective

Area of Science:

• Speech-language pathology
• Psychometrics
• Communication science

Background:

• Standardized assessment misuse is a persistent issue in speech-language pathology.
• Traditionally attributed to clinician competency, this perspective overlooks other contributing factors.

Purpose of the Study:

• To examine the role of communication breakdowns between test developers and end-users in assessment misuse.
• To propose a framework for improving the alignment between test design and clinical application.

Main Methods:

• Utilized the 2-communities theory to conceptualize test development as a collaborative process.
• Analyzed the psychometric properties and validation processes of common speech-language pathology assessments.
• Compared the theoretical underpinnings of classical test theory with item response theory.

Main Results:

• Identified a significant mismatch between the interpretations tests are validated for and the decisions clinicians must make.
• Classical test theory, prevalent in current assessments, exacerbates this disconnect.
• Item response theory offers potential for improved psychometric evidence but is underutilized.

Conclusions:

• Clinical perspectives and decision-making needs must be integrated into the test validation process.
• Advocating for improved statistical evidence in standardized assessments is crucial.
• Enhancing assessment tools ensures they meet professional obligations effectively and practically.