Related Experiment Video
Updated: Feb 12, 2026
Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Assessment of EVAR Competence: Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting
Michael Strøm1, Lars Lönn2, Lars Konge3
1Copenhagen Academy for Medical Education and Simulation, The Capital Region of Denmark, Copenhagen, Denmark; Department of Vascular Surgery, Rigshospitalet, Copenhagen, Denmark; University of Copenhagen, Copenhagen, Denmark.
Objectives:
The aims of this study were to investigate the validity evidence for a novel procedure specific assessment tool of competence in endovascular aortic repair (EVAR) and to establish a pass/fail level for the assessment.
Methods:
Computed tomography angiography data of a 55 mm in diameter infrarenal aortic aneurysm was implemented into an endovascular simulator. Twenty-three physicians with varying EVAR experiences were video-recorded when performing a standard EVAR procedure on the simulator. Two experienced EVAR operators assessed the participants using the novel rating scale, "EndoVascular Aortic Repair Assessment of Technical Expertise" (EVARATE). Validity was studied according to the framework endorsed by the American Educational Research Association.
Results:
The EVARATE scale had a high internal consistency (Cronbach's alpha = .90). The inter-rater reliability was acceptable (Intraclass Correlation Coefficient = .68, p = .005). Specific EVAR experience correlated significantly with the EVARATE score (Spearman's rho = .62, p = .002), but general endovascular experience did not. Consequence analysis showed that the EVARATE assessment could distinguish novices from intermediates (p < .01) and from experts (p < .001). A pass/fail score was determined using the contrasting groups' method.
Conclusion:
This paper presents the initial validity evidence for a novel procedure specific assessment tool, EVARATE, for operator competence in endovascular aortic repair investigated in a simulated setting. The assessment tool can be used to provide structured formative feedback to trainees.
Related Concept Videos
01:29Reliability and Validity
01:20Assessment of Ventilation I: Respiratory Rate
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
03:08Rate-Determining Steps
In a multistep reaction mechanism, one of the elementary steps progresses significantly slower than the others. This slowest step is called the rate-limiting step (or rate-determining step). A reaction cannot proceed faster than its slowest step, and hence, the rate-determining step limits the overall reaction rate.
The concept of rate-determining step can be understood from the analogy of a 4-lane freeway with a short-stretch of traffic-bottleneck caused due to...
02:41pH Scale
02:53Reaction Rate
The mathematical representation of the change in the concentration of reactants and products, over time, is the rate...
01:15Data Validation
Key parameters for method validation include: