Related Experiment Videos
Validation of a test of competence in transesophageal echocardiography
S N Konstadt1, D L Reich, T Rafferty
1Department of Anesthesiology, Mount Sinai Medical Center, New York, NY 10029, USA.
Objective:
A test was developed that is based on intraoperative findings to evaluate knowledge of intraoperative echocardiography. This study examines the performance of attending anesthesiologists and residents at various levels of training in order to validate the test's ability to measure physician competence in intraoperative echocardiographic diagnosis.
Design:
This study was a prospective evaluation of a test of competence in transesophageal echocardiography.
Setting:
Two university medical centers.
Participants:
Volunteer anesthesia faculty and residents.
Interventions:
The participants took an echocardiographic examination that consisted of 34 "K"-type multiple-choice questions and a 45-second video-loop sequence for each question. The video sequences were chosen for their high quality and unambiguous representation of both normal and pathologic images obtained by transverse transesophageal echocardiographic imaging. The questions were written by experienced echocardiographers. The test was administered to 25 individuals at two academic institutions: 11 residents with minimal transesophageal echocardiography exposure and 14 faculty who were relatively experienced with transesophageal echocardiography. All of the residents repeated the examination at the end of their third clinical anesthesia year, which included transesophageal echocardiography training. The differences between the groups' scores were analyzed using the Kruskal-Wallis test and Wilcoxon's rank-sum test. To correct for the multiple comparisons, p < 0.025 was deemed significant. MEASUREMENTS AND MAIN RESULTS. Before their transesophageal echocardiography training, the residents scored significantly lower than the faculty (p < 0.002). After 1 year of training, their scores significantly increased (p = 0.021), and their scores were not significantly different from the faculty level (p = 0.052).
Conclusions:
Test performance differed according to level of experience. This suggests that the test is a valid measure of intraoperative transesophageal echocardiography competence.