Qualitatively Assessing ChatGPT Responses to Frequently Asked Questions Regarding Sexually Transmitted Diseases

ChatGPT, a large language model artificial intelligence platform that uses natural language processing, has seen its implementation across a number of sectors, notably in health care. However, there remains limited understanding regarding the efficacy of ChatGPT in addressing commonly asked questions on public health subjects. This study aimed to investigate whether ChatGPT could appropriately answer frequently asked questions related to sexually transmitted diseases (STDs).

Ten frequently asked questions on STDs were gathered from 25 different government agency websites. The questions were inputted into ChatGPT, and subsequent responses were analyzed for accuracy, clarity, and appropriateness using an evidence-based approach on a 4-point grading scale.

Of the responses provided by ChatGPT, 4 were determined to be excellent requiring no clarification and 6 requiring minimal clarification. No responses were graded as unsatisfactory. Additionally, the responses appropriately emphasized consulting a health care specialist.

Although the majority of responses required minimal clarification, ChatGPT has the potential to be an effective supplementary tool for patient education. Additional research is necessary to explore possible public health strategies that incorporate artificial intelligence to address concerns related to STDs.