Semi-automated Clinical Content Curation of COVID-19 Chatbot Remote Patient Monitoring Solution

Remote patient monitoring (RPM) programs are being increasingly utilized in the care of patients to manage acute and chronic disease including with acute COVID-19. The goal of this study is to explore the topics and patterns of patients' messages to the care team in an RPM program in patients with presumed COVID-19. We conducted a topic analysis to 6,262 comments from 3,248 patients enrolled in the COVID-19 RMP at M Health Fairview. Evaluation of comments was performed using LDA and CorEx topic modeling. Subject matter experts evaluated topic models, including identification of and defining topics and categories. Topics plotted over time to identify trends in topic weights over the enrollment period. The overall accuracy of comments assignment to topics by LDA and CorEx models were 72.8% and 88.2%. Most identified topics focused on signs and symptoms of COVID-19. Topics related to COVID-19 diagnosis demonstrated a correlation with announcements of availability of viral and antibody testing in national and local media.