Numerical Assessment Tool to Measure Realism in Clinical Simulation

Area of Science:

• Medical Education
• Simulation Technology
• Quantitative Research Methods

Background:

• Realism is crucial for effective clinical simulation learning.
• Objective measurement of realism in simulation is lacking.
• Standardized tools are needed to assess simulation fidelity.

Purpose of the Study:

• To present the methodology of a novel numerical and digital tool, ProRealSim v.1.0, for objectively measuring realism in clinical simulation.
• To develop a tool that assesses realism across three dimensions: simulated participant, scenography, and simulator.
• To foster a culture of interpreting realism for improved study and didactic application.

Main Methods:

• Development of ProRealSim v.1.0, incorporating indicators for accuracy and naturality.
• Expert review (12 experts) of 73 initial qualitative indicators, reduced to 53 after a screening study of 8 medical simulation scenarios.
• Statistical analysis including inter- and intra-observer concordance, correlation, internal consistency, and exploratory factorial analysis (p < 0.05).

Main Results:

• ProRealSim v.1.0 quantifies realism across simulated participant, scenography, and simulator dimensions.
• High internal consistency was achieved (raw_alpha ≥ 0.9698094).
• Realism units were weighted based on variability and mathematical contribution to global and dimensional realism.

Conclusions:

• ProRealSim v.1.0 provides an objective method to measure clinical simulation realism.
• The tool is integrated into a free, open-access digital platform to support simulation-based learning.
• The platform aims to enhance the study and didactic use of clinical simulation realism.