Initial Experience with a COVID-19 Screening Chatbot Before Radiology Appointments

Guidelines for COVID-19 issued by the Centers for Disease Control and Prevention prompted state and local governments to mandate safety measures for screening high-risk patient populations and for institutions to look for ways to limit human contact when possible. The aim of this study was to determine the feasibility of an automated communication system (chatbot) for COVID-19 screening before patients' radiology appointments and to describe patient experiences with the chatbot. We developed a chatbot for COVID-19 screening before outpatient radiology examination appointments and tested it in a pilot study from July 6 to August 31, 2020. The chatbot assessed the presence of any symptoms, exposure, and recent testing. User experience was assessed via a questionnaire based on a 5-point Likert scale. Multivariable logistic regression was performed to predict response rate. The chatbot COVID-19 screening SMS message was sent to 4687 patients. Of these patients, 2722 (58.1%) responded. Of the respondents, 46 (1.7%) reported COVID-19 symptoms; 34 (1.2%) had COVID-19 tests scheduled or pending. Of the 1965 nonresponders, authentication failed for 174 (8.8%), 1496 (76.1%) did not engage with the SMS message, and 251 (12.8%) timed out of the chatbot. The mean rating for the chatbot experience was 4.6. In a multivariable logistic regression model predicting response rate, English written-language preference independently predicted response (odds ratio, 2.71 [95% CI, 1.77-2.77]; P = .007). Age (P = 0.57) and sex (P = 0.51) did not predict response rate. SMS-based COVID-19 screening before scheduled radiology appointments was feasible. English written-language preference (not age or sex) was associated with higher response rate.