Related Experiment Video
Updated: Jun 19, 2025
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
539
Disparities in medical recommendations from AI-based chatbots across different countries/regions.
Khanisyah E Gumilar1,2, Birama R Indraprasta3, Yu-Cheng Hsu4,5
1Graduate Institute of Biomedical Science, China Medical University, Taichung, Taiwan. khanisyah@fk.unair.ac.id.
Scientific Reports
|July 24, 2024
Summary
AI chatbot healthcare information varies significantly by region and platform. Bard generally provided superior responses, highlighting the need for equitable access to reliable AI medical advice.
Area of Science:
- Artificial Intelligence in Medicine
- Oncology Decision Support
- Global Health Informatics
Background:
- Healthcare information access is crucial for patient outcomes.
- AI chatbots offer potential for disseminating medical knowledge.
- Geographic and platform-based disparities in AI-generated health information are not well understood.
Purpose of the Study:
- To evaluate AI chatbot performance in providing adjuvant therapy recommendations for endometrial cancer.
- To identify disparities in AI healthcare information quality across different regions and platforms.
- To assess the potential of AI chatbots in delivering equitable medical guidance.
Main Methods:
- Utilized identical case-based questions for AI chatbots (Bard, Bing, ChatGPT-3.5) across four regions (Indonesia, Nigeria, Taiwan, USA).
- Employed a double-blinded evaluation by ten endometrial cancer experts assessing relevance, clarity, depth, focus, and coherence.
- Analyzed response variations based on geographic location and AI platform using statistical methods.
Main Results:
- Significant variations in AI chatbot responses were observed across different countries/regions (p < 0.001).
- Bing chatbots in Nigeria demonstrated superior performance (p < 0.05) across all criteria (p < 0.001).
- Bard chatbots consistently outperformed ChatGPT-3.5 and Bing globally (p < 0.001), with notable strengths in Nigeria (p < 0.05).
Conclusions:
- AI-generated healthcare information quality is influenced by user location and the AI platform used.
- Significant disparities exist, necessitating further research and development for equitable access to trustworthy AI medical information.
- Optimizing AI chatbots for consistent, high-quality medical advice globally is essential.
Related Concept Videos
01:29Issues And Trends In Healthcare Delivery System
5.6K
The issues and trends in healthcare delivery are constantly changing. The COVID-19 pandemic is one recent issue that wreaked havoc on healthcare systems, causing a shortage of healthcare workers, high demand for medicines and supplies, and increased medical expenditure due to a lack of insurance. Other issues include rising healthcare costs and care fragmentation.
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
5.6K
01:21Barriers to Effective Communication II
3.6K
The barriers to effective communication also include cultural barriers, semantic barriers, gender barriers, and time constraints.
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
Cultural barriers:
Differences in values, beliefs, religion, knowledge, and tradition can significantly impact communication. Awareness of nonverbal cues is critical, especially when conversing with a patient from a different culture. What appears appropriate in one culture may be inappropriate in another.
Semantic barriers:
As a result of their tendency to use...
3.6K
01:08The Availability Heuristic
5.9K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
5.9K
01:27Ethical Issues
890
Nurses are essential in patient care, upholding the ethical principles of their profession and effectively navigating ethical dilemmas. Neglecting ethical issues can lead to inadequate patient care, compromised therapeutic relationships, and moral distress among healthcare workers.
Ethical Concerns in Healthcare:
Ethical Concerns in Healthcare:
890
01:30Current Trends in Nursing II
1.2K
Trends in nursing are multifactorial and associated with changes in society, within the nursing profession, and in other professions. Notably, telehealth and remote nursing contribute to successful healthcare delivery for numerous patients and help reduce stress for nurses due to nursing shortages. Nurses can reach patients, monitor their conditions, and interact with them using computers, audio, visual accessories, and telephones—for example, remote patient monitoring systems. Likewise,...
1.2K
01:16Bioequivalence: Overview
965
Pharmaceutical equivalents, by definition, are drug products with the same active ingredient in the same quantities, encapsulated in identical dosage forms, and intended for the same administration routes. These pharmaceutical equivalents are deemed bioequivalent if the bioavailability of the active entity in the drug preparations is similar. Moreover, pharmaceutical equivalents demonstrating bioequivalence are also regarded as therapeutically equivalent. This means that when used as directed,...
965