Related Experiment Video
Updated: Jan 12, 2026
07:54
Drug-Induced Sleep Endoscopy DISE with Target Controlled Infusion TCI and Bispectral Analysis in Obstructive Sleep Apnea
Published on: December 6, 2016
20.5K
Experts V/S AI´s 2.0: Comparative evaluation of AI models and expert consensus in obstructive sleep apnea assessment
Giovanni Cammaroto1,2, Felipe Ahumada Mira2,3, Valentin Favier2,4
1Head and Neck Department, ENT & Oral Surgery Unity, G.B. Morgagni, L. Pierantoni Hospital, Forlì, Italy.
Summary
Artificial intelligence chatbots show promise in managing obstructive sleep apnea (OSA), but expert human judgment remains crucial for complex cases. ChatGPT-3.5 surprisingly outperformed newer AI models in this study.
Area of Science:
- Medical Informatics
- Artificial Intelligence in Medicine
- Sleep Medicine
Background:
- Obstructive sleep apnea (OSA) management requires expert clinical judgment.
- Artificial intelligence (AI) chatbots are increasingly explored for medical applications.
- Evaluating AI performance in specialized medical domains is essential.
Purpose of the Study:
- To compare the diagnostic and management recommendations of AI chatbots for obstructive sleep apnea (OSA) against expert otolaryngologist consensus.
- To assess the performance of ChatGPT-3.5, ChatGPT-4.0, and Gemini in responding to OSA-related clinical scenarios.
- To determine the utility of AI as a complementary tool in OSA management.
Main Methods:
- A 10-question survey on OSA management was administered to ChatGPT-3.5, ChatGPT-4.0, Gemini, and 100 otolaryngologists.
- Responses were evaluated by ten sleep medicine super-experts using a Likert scale for agreement with expert consensus.
- Statistical analyses were conducted to compare AI performance against human expert consensus.
Main Results:
- Expert consensus achieved the highest score (4.5 ± 0.9), significantly outperforming all AI models.
- ChatGPT-3.5 (4.1 ± 1.2) performed best among AI, followed by ChatGPT-4.0 (3.9 ± 1.4) and Gemini (3.6 ± 1.5).
- AI models showed agreement in specific scenarios but struggled with complex cases requiring multi-factor integration, particularly in therapeutic management.
Conclusions:
- AI models show potential as supportive tools for OSA management in well-defined scenarios.
- Human expert clinical judgment remains indispensable for complex OSA cases.
- ChatGPT-3.5's superior performance over newer versions highlights that general AI model updates do not always translate to better specialized medical domain performance.
More Related Videos
Related Concept Videos
01:21Sleep Apnea
465
Sleep apnea is a condition where breathing stops intermittently during sleep, often leading to significant health issues. Each episode can last from 10 to 20 seconds or more and is frequently accompanied by a brief arousal from sleep. This disturbance, largely unnoticed by the individual, can lead to severe daytime fatigue. Commonly, individuals seek help after being informed by their partners about loud snoring and noticeable breathing pauses during sleep.
The condition is more prevalent among...
The condition is more prevalent among...
465
01:30Assessment of Airway, Skin Color, and Use of Accessory Muscles
1.6K
A thorough assessment of respiratory health is paramount in clinical settings to identify and manage respiratory distress and ensure adequate oxygenation. This article elaborates on the critical aspects of respiratory evaluation, including airway assessment, skin color examination, and the observation of accessory muscle use, which are integral to effectively diagnosing and managing patients with respiratory conditions.
Introduction
The initial evaluation of a patient's respiratory system...
Introduction
The initial evaluation of a patient's respiratory system...
1.6K
01:22Cardiopulmonary Resuscitation II: ACLS Airway Management
509
Airway management is a key skill in emergency and critical care settings, as maintaining a clear airway is essential for adequate oxygenation and ventilation.Head Tilt-Chin Lift TechniqueThe head tilt-chin lift maneuver is an essential technique primarily used in patients without suspected cervical spine injuries. To perform this maneuver, one hand is placed on the patient’s forehead, and gentle pressure is applied backward to tilt the head. The fingertips of the other hand are positioned...
509
01:27Physical Assessment of the Respiratory Tract II: Inspection
826
Physical assessment of the respiratory tract through inspection is a crucial step in understanding the patient's respiratory health. It provides insights into the functioning of the respiratory system, the musculoskeletal structure, and even the patient's nutritional status. This comprehensive approach involves observing several vital aspects: chest configuration, breathing patterns, respiratory rates, skin color, and use of accessory muscles.
Chest Configuration
The chest configuration...
Chest Configuration
The chest configuration...
826
01:20Assessment of Ventilation I: Respiratory Rate
1.9K
Assessment of Ventilation
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
A Ventilation assessment is critical for monitoring a patient's health status. Respiration, one of the most accessible vital signs, provides insights into the function of numerous body systems and can indicate serious health issues, such as brainstem injuries from head trauma.
Critical Guidelines for Assessing Ventilation:
1.9K