Related Experiment Video
Updated: Jun 8, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Validity evidence for USMLE examination cut scores: results of a large-scale survey
Melissa J Margolis1, Brian E Clauser, Marcia Winward
1mmargolis@nbme.org
Purpose:
This research examined the credibility of the cut scores used to make pass/fail decisions on United States Medical Licensing Examination (USMLE) Step 1, Step 2 Clinical Knowledge, and Step 3.
Method:
Approximately 15,000 members of nine constituency groups were asked their opinions about (1) current initial and ultimate fail rates and (2) the highest acceptable, lowest acceptable, and optimal initial and ultimate fail rates.
Results:
Initial fail rates were generally viewed as appropriate; more variability was associated with ultimate fail rates. Actual fail rates for each examination across recent years fell within the range that respondents considered acceptable.
Conclusions:
Results provide important evidence to support the appropriateness of the cut scores used to make classification decisions for USMLE examinations. This evidence is viewed as part of the overall validity argument for decisions based on USMLE scores.
Related Concept Videos
Reliability and Validity
Sign Test for Median of Single Population
Surveys
Wilcoxon Rank-Sum Test
Unusual Results
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value = μ + 2σ
Minimum unusual value...
Wilcoxon Signed-Ranks Test for Matched Pairs
