Related Experiment Video
Updated: Jan 27, 2026

Using a Virtual Reality Walking Simulator to Investigate Pedestrian Behavior
Published on: June 9, 2020
A Comparison of Visual Rating Scales and Simulated Virtual Reality Metrics in Neurosurgical Training: A
Alexander Winkler-Schwartz1, Ibrahim Marwa1, Khalid Bajunaid2
1Neurosurgical Simulation and Artificial Intelligence Learning Centre, Department of Neurology & Neurosurgery, McGill University, Montreal, Quebec, Canada.
Background:
Adequate assessment and feedback remains a cornerstone of psychomotor skills acquisition, particularly within neurosurgery where the consequence of adverse operative events is significant. However, a critical appraisal of the reliability of visual rating scales in neurosurgery is lacking. Therefore, we sought to design a study to compare visual rating scales with simulated metrics in a neurosurgical virtual reality task.
Methods:
Neurosurgical faculty rated anonymized participant video recordings of the removal of simulated brain tumors using a visual rating scale made up of seven composite elements. Scale reliability was evaluated using generalizability theory, and scale subcomponents were compared with simulated metrics using Pearson correlation analysis.
Results:
Four staff neurosurgeons evaluated 16 medical student neurosurgery applicants. Overall scale reliability and internal consistency were 0.73 and 0.90, respectively. Reliability of 0.71 was achieved with two raters. Individual participants, raters, and scale items accounted for 27%, 11%, and 0.6% of the data variability. The hemostasis scale component related to the greatest number of simulated metrics, whereas respect for no-go zones and tissue was correlated with none. Metrics relating to instrument force and patient safety (brain volume removed and blood loss) were captured by the fewest number of rating scale components.
Conclusions:
To our knowledge, this is the first study comparing participant's ratings with simulated performance. Given rating scales capture less well instrument force, quantity of brain volume removed, and blood loss, we suggest adopting a hybrid educational approach using visual rating scales in an operative environment, supplemented by simulated sessions to uncover potentially problematic surgical technique.
Related Concept Videos
Column Efficiency: Rate Theory
During elution, a solute molecule experiences numerous transitions between stationary and mobile phases, exhibiting irregular residence times in...
The Sense of Self: Reflected Self-Appraisal and Social Comparison
Social Exchange Theory
Band Theory
The energy difference between these bands is known as the band gap.
Conductor, Semiconductor,...
Attribution Theory
The Atomic Theory of Matter

