Related Experiment Videos
Outcomes in CME/CPD - Special Collection: Effect Size Benchmarking for Internet-based Enduring CME Activities
Jason J Olivieri1, Mary Catherine Downes1
1Med-IQ, LLC, Baltimore, Maryland.
Journal of European CME
|November 12, 2020
Summary
Internet enduring materials for clinicians have nearly doubled. A pooled analysis suggests a Cohen's d benchmark of 0.48-0.75 for evaluating online Continuing Medical Education effectiveness.
Area of Science:
- Medical Education
- Digital Health
- Continuing Medical Education (CME)
Background:
- The production of certified internet enduring materials has nearly doubled in the past decade.
- Meta-analyses confirm the effectiveness of internet-based clinician education.
- The applicability of existing meta-analyses to the large volume of certified online CME activities is uncertain.
Purpose of the Study:
- To establish a relevant benchmark for the effectiveness of accredited, internet-based enduring materials.
- To analyze the pooled effect size of online CME materials using a standardized mean difference (Cohen's d).
- To assess the comparability of online CME effectiveness data with external benchmarks.
Main Methods:
- A pooled standardized mean difference (Cohen's d) was calculated.
- Data was analyzed from 40 accredited, internet-based enduring materials.
- Materials were produced between 2016 and 2018.
Main Results:
- A pooled Cohen's d between 0.48 and 0.75 was identified as a potential benchmark.
- Benchmarks reported in peer-reviewed literature for this format are generally higher.
- Limitations in comparing current data with external benchmarks were considered.
Conclusions:
- The identified benchmark (Cohen's d: 0.48-0.75) offers a metric for CME providers to assess online enduring material effectiveness.
- Caution is advised when comparing these findings to benchmarks from peer-reviewed literature due to potential differences in methodology and scope.
- Further research may be needed to refine benchmarks for online CME effectiveness.