Related Experiment Video
Updated: Mar 23, 2026
11:29
Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
9.9K
A multi-source feedback tool for measuring a subset of Pediatrics Milestones
Alan Schwartz1,2, Melissa J Margolis3, Sara Multerer4
1a Department of Medical Education , University of Illinois at Chicago , Chicago , IL , USA.
Medical Teacher
|March 31, 2016
Summary
Multisource feedback (MSF) ratings of pediatric residents are moderately reliable for informing milestone assignments. Data show rater and learner factors influence scores, with some rater groups providing significantly different feedback.
Area of Science:
- Medical Education
- Pediatric Residency Training
- Competency-Based Assessment
Background:
- The Pediatrics Milestones Assessment Pilot utilized a novel multisource feedback (MSF) instrument.
- This tool assessed nine Pediatrics Milestones in inpatient interns and subinterns.
Purpose of the Study:
- To provide validity evidence for the MSF tool.
- To support milestone classification decisions in pediatric residency.
Main Methods:
- MSF instruments were collected from diverse raters (faculty, senior residents, nurses, other staff) per learner per rotation.
- Validity evidence was presented using the unified validity framework.
Main Results:
- 192 interns and 41 subinterns provided 1084 MSF forms.
- Rater (32%) and learner (22%) accounted for most rating variance; milestone factor structure fit data well.
- Nurse ratings were lower than faculty; other staff ratings were higher. Longer observation and positive global opinion correlated with higher ratings.
Conclusions:
- Moderately reliable MSF ratings were obtained for pediatric interns and subinterns.
- These ratings can inform some milestone assignments in the inpatient setting.
