Evidence-based medical education -quo vadis?

The evidence base for most educational initiatives, at least until very recently, is largely composed of low-level evidence. Four major barriers underlie this historical observation, namely: (1) perceived ethical and acceptability problems arising from the unequal treatment of learners in experimental designs; (2) limited choice of outcome measures and validated instruments; (3) time and resource constraints; and (4) methodological issues concerning contextual confounding and small sample sizes. We advocate the adoption of a 'balanced scorecard' approach in the evaluation of education interventions that brings together a comprehensive panel of outcomes under one framework. We require a diversity of rigorously applied methods to generate these outcomes, drawing from the quantitative and qualitative disciplines of epidemiology, psychology and economics. We further suggest that the research community discuss and agree on a standardized set of common metrics or benchmarks. We conclude with a case study examining whether a hand-held computer clinical decision support tool improves clerkship learning of evidence-based medicine. The era of Brownian motion in health education research is over. What we demand in terms of burden of proof for educational effectiveness should be no less rigorous than our call for an ever escalating threshold concerning evidence of clinical care.