Related Experiment Videos
Development and evaluation of a decision-based simulation for assessment of team skills
Brandon Andrew1, Stephen Plachta, Lawrence Salud
1Feinberg School of Medicine, Northwestern University, Chicago, Illinois, USA.
Background:
There is a need to train and evaluate a wide variety of nontechnical surgical skills. The goal of this project was to develop and evaluate a decision-based simulation to assess team skills.
Methods:
The decision-based exercise used our previously validated Laparoscopic Ventral Hernia simulator and a newly developed team evaluation survey. Five teams of 3 surgical residents (N = 15) were tasked with repairing a 10 × 10-cm right upper quadrant hernia. During the simulation, independent observers (N = 6) completed a 6-item survey assessing: (1) work quality; (2) communication; and (3) team effectiveness. After the simulation, team members self-rated their performance by using the same survey.
Results:
Survey reliability revealed a Cronbach's alpha of r = .811. Significant differences were found when we compared team members' (T) and observers' (O) ratings for communication (T = 4.33/5.00 vs O = 3.00/5.00, P < .01) and work quality (T = 4.33/5.00 vs O = 3.33/5.00, P < .05). The team with the greatest survey ratings was the only group to successfully complete the task.
Conclusion:
The team evaluation survey had good reliability and correlated with task performance on the simulator. Our current and previous work provides strong evidence that nontechnical and team related skills can be assessed without simulating a crisis situation.
Related Concept Videos
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
Decision Making
Automatic decision-making is fast, intuitive, and relies on gut feelings...
Decision Making: P-value Method
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can have a...
Self-Evaluation Maintenance Model