Updating the Simulation Effectiveness Tool: Item Modifications and Reevaluation of Psychometric Properties.

Area of Science:

• Nursing Education
• Simulation-Based Learning
• Psychometric Evaluation

Background:

• The original Simulation Effectiveness Tool (SET) was updated to align with current nursing education standards.
• Updates incorporated INACSL Standards of Best Practice, QSEN, and AACN essentials.
• The revised tool, SET-M, aims to reflect contemporary simulation practices.

Purpose of the Study:

• To evaluate the psychometric properties of the modified Simulation Effectiveness Tool (SET-M).
• To determine the validity and reliability of the SET-M for assessing student perceptions of simulation effectiveness.

Main Methods:

• Undergraduate nursing students (N=1,288) from two programs completed the SET-M post-simulation.
• Exploratory factor analysis using unweighted least squares was performed.
• Internal consistency was assessed for identified subscales.

Main Results:

• Four subscales emerged from factor analysis: Prebriefing, Learning, Confidence, and Debriefing.
• All subscales exhibited acceptable internal consistency.
• Prebriefing (α = .833), Learning (α = .852), Confidence (α = .913), and Debriefing (α = .908).

Conclusions:

• The SET-M is a psychometrically sound instrument for evaluating simulation effectiveness.
• The revised tool provides a valid and reliable measure of student perceptions in simulation environments.
• SET-M supports the assessment of learning within simulation-based nursing education.