Parent Questions About Childhood Hearing Loss: An Evaluation of ChatGPT Response Accuracy, Completeness, and
Karen Muñoz1, Tess C Hurd1, Danielle Glista2
1Department of Communicative Disorders and Deaf Education, Utah State University, Logan.
Purpose:
We aimed to assess the responses to parent questions about childhood hearing loss that were generated by two generative artificial intelligence (AI) chatbots, ChatGPT-4o mini and ChatGPT Professional (Pro).
Method:
Sixty-four questions grouped into three categories (hearing loss, hearing aids, and family) were queried in both platforms and rated for accuracy, completeness, readability, and repeatability. Paired-samples t tests were calculated to determine differences in responses between platforms.
Results:
ChatGPT Pro was judged as more accurate for hearing aids and more complete for questions related to hearing loss and hearing aids compared to ChatGPT-4o mini, and ChatGPT-4o mini responses were judged as more complete compared to ChatGPT Pro for questions related to family (e.g., emotions, talking to others). Readability scores revealed that responses were generally written in a complex manner.
Conclusions:
Responses generated on both platforms were generally judged as accurate and complete, suggesting that AI could contribute to supporting parent education needs. Further research is needed to explore strategies for improving the accuracy and completeness of AI-generated responses, including the collection of supplemental information from parent users to guide and/or prompt responses.
More Related Videos
06:04Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
Published on: March 24, 2023
11:39Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
Published on: September 7, 2022