Levels of Evidence for Hand Questions on the Orthopaedic In-Training Examination

Background: Although analyses of the Orthopaedic In-Training Examination (OITE) subspecialty content domains have been performed, few studies have analyzed the levels of evidence (LoEs) for journal articles used as references to create OITE questions. We present an analysis of reference characteristics and question taxonomy for the hand surgery content domain on the OITE. We aim to determine whether level of evidence (LoE) for hand surgery questions have increased over a 15-year period. Methods: All questions and references in the hand surgery content domain on the OITE from 1995-1997 and 2010-2012 were reviewed. The taxonomic classification was determined for each question. Publication characteristics were defined for each reference, and each primary journal article was assigned a LoE. Results: A total of 129 questions containing 222 references met inclusion criteria: 76 questions from 1995-1997 and 53 from 2010-2012. The Journal of Hand Surgery American and European Volumes, Journal of Bone and Joint Surgery American and British Volumes, and the Journal of the American Academy of Orthopaedic Surgeons were the most frequently cited journals overall. Recent examinations were more likely to have Buckwalter T3 complex clinical management questions. There was a statically significant increase in the LoE used to create hand questions on the 2010-2012 compared with the 1995-1997 OITE. Conclusions: Primary journal articles cited on the hand surgery content domain of the OITE frequently included recent publications from both general and subspecialty journals. More recent examination questions appear to test clinical management scenarios. LoE for hand questions has increased over a 15-year period. Our results can be used as a guide to help prepare orthopedic residents for the OITE.