Related Experiment Video
Updated: Jun 1, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
The Development and Evaluation of Procedures to Assess Child Self-report Item Validity
Michael E Woolley1, Gary L Bowen, Natasha K Bowen
1University of Michigan, Ann Arbor.
None:
Cognitive pretesting (CP) is an interview methodology for pretesting the validity of items during the development of self-report instruments. The present research evaluates a systematic approach to the analysis of CP data. Materials and procedures were developed to rate self-report item performance with CP interview text data. Five raters were trained in the application of that system. Estimates of inter-rater reliability found acceptable to substantial levels of inter-rater agreement. Results from the present study suggest that excellent inter-rater reliability can be achieved in the evaluation of CP data. Guidelines for systematically rating the qualitative data collected using CP methods are provided. Future research should focus on empirical demonstrations of how such rating procedures can lead to improvements in self-report instruments.
Related Concept Videos
Self-Report Tests of Personality
Reliability and Validity
Social Foundations of Self III: Self-Evaluation
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Self-Evaluation: Self-Enhancement and Self-Verification
Data Validation
Key parameters for method validation include:
