Mobile app technology is associated with improved otolaryngology resident in-service performance

Otolaryngology residents face time-management challenges between clinical duties and self-directed learning. Mobile devices provide a new medium for education that could aid with educational efficiency. The objective of this study was to investigate whether spaced repetition mobile app use of an otolaryngology question bank was associated with improving factual knowledge as measured by in-service exam performance.

For approximately 6 months prior to the 2016 in-service examination, 12 otolaryngology residents at a single institution were provided access to a spaced-repetition app with a preloaded licensed otolaryngology review question bank. The number of questions answered, as well as the time spent on the app, were electronically tracked. The associations of app usage on in-service results were analyzed using an autoregressive model adjusted for prior historical Otolaryngology Trainee Examination performance and postgraduate year.

Eleven residents used the mobile app and were included in the analysis for an average of 304 minutes (range: 3 to 1,020) and reviewed on average 679 questions (range: 6 to 1,934). Controlling for residency year and prior performance, app usage was associated with an improvement by 2.92 percentage points (pp) (95% confidence interval [CI]: 0.14, 5.70) on overall in-service score. Allergy and pediatric subsection scores improved by 11.3 pp (95% CI: 3.8, 18.8) and 15.2 pp. (95% CI: 8.9, 21.5), respectively. Increased app use was associated with a score improvement by 0.008 pp per minute of use (95% CI: 0.004, 0.012).

Use of mobile spaced-repetition technology can aid resident factual knowledge retention measured by improved in-service exam performance.

4 Laryngoscope, 129:E15-E20, 2019.