Related Experiment Video
Updated: Jun 1, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
The relationship between formative and summative examinations and PANCE scores; can the past predict the future?
Scott Massey1, John Stallman, Louise Lee
1Massachusetts College of Pharmacy and Health Sciences (MCPHS), Department of Physician Assistant Studies, Manchester Campus, USA. scott.massey@mcphs.edu
Purpose:
This paper describes how a systematic analysis of students at risk for failing the Physician Assistant National Certifying Examination (PANCE) may be used to identify which students may benefit from intervention prior to taking the PANCE and thus increase the likelihood of successful completion of the PANCE. The intervention developed and implemented uses various formative and summative examinations to predict students' PANCE scores with a high degree of accuracy.
Methods:
Eight end-of-rotation exams (EOREs) based upon discipline-specific diseases and averaging 100 questions each, a 360-question PANCE simulation (SUMM I), the PACKRAT, and a 700-question summative cognitive examination based upon the NCCPA blueprint (SUMM II) were administered to all students enrolled in the program during the clinical year starting in January 2010 and concluding in December 2010.
Results:
When the PACKRAT, SUMM I, SUMM II, and the surgery, women's health, and pediatrics EOREs were combined in a regression model, an Rvalue of 0.87 and an R2 of 0.75 were obtained. A predicted score was generated for the class of 2009. The predicted PANCE score based upon this model had a final correlation of 0.790 with the actual PANCE score.
Conclusion:
This pilot study demonstrated that valid predicted scores could be generated from formative and summative examinations to provide valuable feedback and to identify students at risk of failing the PANCE.
More Related Videos
06:28E-Patient Counseling Trial (E-PACO): Computer Based Education versus Nurse Counseling for Patients to Prepare for Colonoscopy
Published on: August 1, 2019
08:33A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Related Concept Videos
Reliability and Validity
Hindsight Biases
Sensitivity, Specificity, and Predicted Value
Sensitivity is the...
Methods of Documentation III: PIE
Theory of Attribution II: Kelley's Covariation Theory
Correlations