Construct validation of progress testing to measure knowledge and visual skills in radiology

Area of Science:

• Medical Education
• Radiology Training
• Assessment Methods

Background:

• The Dutch Radiology Progress Test (DRPT) is crucial for monitoring knowledge and visual skill acquisition in Dutch radiology residents.
• Evaluating the DRPT's quality is essential for effective postgraduate radiology training.

Purpose of the Study:

• To assess the reliability and construct validity of the DRPT.
• To investigate the expected pattern of knowledge and visual skill development during radiology residency.
• To determine if DRPT scores reflect rapid initial learning followed by a plateau.

Main Methods:

• Internal consistency was measured using Cronbach's alpha.
• One-way ANOVA was used to analyze performance increases across residency years.
• Data from 498 residents (2281 test results) were analyzed.

Main Results:

• The DRPT demonstrated high reliability with Cronbach's alpha around 0.90.
• Significant performance increases were observed in the first three residency years.
• Knowledge and visual skill scores plateaued after the fourth year, with visual skills showing a sharper increase initially.

Conclusions:

• The DRPT shows strong reliability and construct validity for assessing radiology residents.
• The findings support the test's ability to reflect learning patterns during residency.
• Further research is recommended to refine the assessment of visual skill development within the DRPT.