Related Experiment Video
Updated: Mar 8, 2026
Creation of a High-Fidelity, Low-Cost, Intraosseous Line Placement Task Trainer via 3D Printing
Published on: August 17, 2022
Retesting the Hypothesis of a Clinical Randomized Controlled Trial in a Simulation Environment to Validate Anesthesia
Alan F Merry1, Jacqueline A Hannam, Craig S Webster
1From the Department of Anaesthesiology, Faculty of Medical and Health Sciences (A.F.M., J.A.H., J.T.), Centre for Medical and Health Sciences Education, Faculty of Medical and Health Sciences (C.S.W., J.M.W.), University of Auckland, Auckland, New Zealand; Anaesthetic Department, St Mary's Hospital, London, United Kingdom (K.-E.E.); Department of Medicine, Christchurch School of Medicine and Health Sciences, University of Otago, New Zealand (C.F.); University Division of Anaesthesia, University of Cambridge, Addenbrooke's Hospital, Cambridge, United Kingdom (D.W.W.); Department of Anaesthesia, Cambridge University Hospitals, Cambridge, United Kingdom (A.K.G.); and Anaesthesia and Critical Care, Division of Clinical Neuroscience, University of Nottingham, Nottingham, United Kingdom (R.P.M., R.E.).
Simulation studies in anesthesia can yield similar primary conclusions to larger clinical trials. However, simulation may not fully capture the effect size differences seen in real-world clinical settings.
Area of Science:
- Anesthesiology
- Medical Simulation
- Clinical Trials
Background:
- Simulation is increasingly used to study clinical questions in anesthesia and surgery.
- However, limited data exist on whether simulation results are applicable to real-world clinical settings.
- This study investigates if simulation findings align with those from larger clinical studies.
Purpose of the Study:
- To determine if a simulation-based study can support the same principal conclusions as a larger clinical study.
- To compare the efficacy of a multimodal system (SAFERsleep) versus conventional methods in reducing drug administration errors.
Main Methods:
- A simulated randomized controlled trial (80 cases) was compared with a clinical randomized controlled trial (1,075 cases).
- Forty anesthesiologists managed simulated scenarios using either conventional methods or the SAFERsleep system.
- The primary endpoint was the rate of drug administration or recording errors.
Main Results:
- The simulated trial showed a significant reduction in errors with the new system (6.0%) compared to conventional methods (11.6%; P=0.001).
- The clinical trial also showed a significant reduction (9.1% vs 11.6%; P=0.045).
- The difference in effect size between the two study types was 27.0% (-7.6 to 61.6%).
Conclusions:
- Simulation-based trials can justify the same primary conclusions as larger clinical trials.
- Simulation may not be sufficient to establish equivalence in effect size compared to clinical trials.
