Can Text Messaging Teach Residents? A Randomized Controlled Trial

Background: Spaced education and the testing effect are both educational methods that increase long-term memory formation; however, these can be difficult to implement during residency training given time constraints. Text messaging is ubiquitous but has not been studied as a spaced education tool.

Objective: Assess if text messaging improves resident knowledge during an inpatient pediatric pulmonary rotation.

Methods: A prospective randomized control study with pediatric residents on a pulmonary inpatient rotation was conducted at an urban free-standing children's hospital between 2016 and 2017. The intervention arm received one daily multiple-choice text message scenario and a scripted teaching text for each response. Both arms received standard pulmonary education. Knowledge was assessed using a 23-item pretest and posttest with unique, nonrepeated items with fair reliability, following iterative revisions. Perceived value of texting was assessed using Likert scales. Paired and unpaired t tests compared knowledge and value scores. The difference between pretest and posttest scores (delta) for both arms was calculated, then compared using an unpaired t test. Spearman's rho evaluated maturation bias. Analysis of variance evaluated year of training as a confounding factor.

Results: A total of 65 residents were randomized, with a response rate of 81%. Posttest mean scores were lower than pretest in both arms, attributed to more difficult questions randomized to the posttest. The intervention arm scored higher on the posttest (P = 0.04). However, the delta mean did not show a statistically significant difference (P = 0.6). Text messaging was viewed as "effective" by 80% of participants in the intervention arm.

Conclusion: A scripted text messaging intervention is perceived as effective by learners but did not result in measurable increased resident knowledge.