ChatGPT as an information source for cochlear implants: A study on accuracy and reproducibility

This study evaluates ChatGPT's accuracy and reproducibility in answering patient inquiries about cochlear implantation.

Forty-one questions were compiled from cochlear implant company websites, clinics, patient support groups, and social media. Questions were categorized into five topics: basic knowledge, information on surgery process, expected results and limitations, answering questions from candidates and families, and technical features of cochlear implant. ChatGPT was queried, and two audiologists and one ENT specialist independently assessed responses for accuracy and reproducibility. Responses were rated as: (1) comprehensive/correct, (2) incomplete/partially correct, (3) a mix of accurate and inaccurate/misleading and (4) completely inaccurate/irrelevant.. Reproducibility was evaluated by repeating questions and analyzing grading consistency.

ChatGPT provided "comprehensive/correct" answers for 34/41 (82.9%) questions, while 12.2% were "incomplete/partially correct" and 4.9% contained a mix of accurate and inaccurate/misleading. No responses were completely inaccurate. By category, it correctly answered 100% of "basic knowledge" and "technical features of cochlear implant" questions, 60% on "information on surgery process," 80% on "expected results and limitations," and 88.9% on "answering questions from candidate and families." Reproducibility was 82.9%.

ChatGPT demonstrates strong accuracy and consistency in responding to cochlear implantation questions. While some limitations exist, it can serve as a useful resource for patients and healthcare providers. With continued improvements, ChatGPT has the potential to enhance clinical counseling.

N/A.