An analysis of AI platforms: Can AI provide genetics education?

Area of Science:

• Biomedical Informatics
• Genetics
• Artificial Intelligence

Background:

• Patients increasingly access health information via AI chatbots.
• Understanding genetic testing is crucial for informed healthcare decisions.

Purpose of the Study:

• To evaluate the accuracy and readability of AI chatbots for genetic testing information.
• To compare the performance of five different AI platforms.

Main Methods:

• Thirty-nine genetic testing FAQs were posed to five AI chatbots.
• Answers were rated by gynecologic oncologists and genetic counselors.
• Readability (Flesch-Kincaid Grade Level) and word count were analyzed.

Main Results:

• No AI platform demonstrated superior accuracy or readability.
• AI-generated answers had a higher average reading level than the average American.
• Reddit Answers performed significantly worse than other platforms.

Conclusions:

• AI chatbots can provide foundational genetic testing knowledge but are not a substitute for professional guidance.
• Genetic counseling is vital due to the personalized nature of genetic testing.
• Healthcare professionals are essential for accurate and applicable genetic testing education.