Related Experiment Video
Updated: Mar 2, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Identification of questionable data using validity indices and item response theory methods: Examinations with a
Christine DiStefano1, Jin Liu1, Fred Greer1
1Department of Educational Studies, University of South Carolina.
Abstract:
To assess quality, psychological instruments often include additional scales or validity indices to alert users to the presence of questionable data. Although identified cases are often scrutinized further or removed, it is not fully understood how such cases may affect overall analyses if retained. Using a teacher-report instrument of child behavior, this study examined 5 different validity indices: F-Index, Consistency Index, Response Pattern Index, Rasch Outfit, and Rasch Infit. Results showed that methods largely did not identify similar cases. Removing flagged cases did not have a great effect on reliability estimates or validity coefficients. Hierarchical linear modeling illustrated that differences in validity indices were significantly related to years of teaching experience and level of education for the F-Index. In general, before using social-emotional screeners, teacher training may be useful to help minimize response effects. (PsycINFO Database Record
Related Concept Videos
Reliability and Validity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Data Validation
Key parameters for method validation include:
Data Validation
Nursing assessment guides are generally based on holistic models rather than medical...
Ratio Level of Measurement
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
Surveys
