评估基于人工智能的工具在检测和理解睡眠健康错误信息方面的有效性:使用Google Bard和OpenAI ChatGPT-4进行比较分析
Sergio Garbarino1,2, Nicola Luigi Bragazzi1,3,4
1Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal, Child Sciences (DINOGMI), University of Genoa, Genoa, Italy.
Journal of sleep research
|April 5, 2024
概括
在揭穿睡眠神话方面,谷歌巴德的准确性比ChatGPT-4 (85%) 高 (95%). 巴德的回复更容易获得,突出了AI在睡眠健康教育中的潜力.
科学领域:
- 睡眠科学 睡眠科学
- 人工智能的人工智能
- 公共卫生 公共卫生
背景情况:
- 睡眠误解很普遍,可能会对公共健康产生负面影响.
- 人工智能 (AI) 工具为传播准确的健康信息提供了潜力.
- 评估人工智能在揭穿健康神话方面的表现对于可靠的公共卫生教育至关重要.
研究的目的:
- 评估ChatGPT-4和谷歌Bard在识别和评分与睡眠有关的神话中的准确性.
- 将人工智能产生的反应与专家对虚假性和公共卫生意义的意见进行比较.
- 分析人工智能响应的特征,包括焦点,可读性和与专家共识一致.
主要方法:
- 评估了20个睡眠误解,使用5点的利克特度量表来评估虚假性和公共健康意义.
- 来自ChatGPT-4和谷歌Bard的回复与专家意见进行了比较.
- 统计分析包括准确性比较,评分者之间的一致性 (类内相关性) 和可读性评估.
- 使用文本挖掘分析来了解AI响应的重点.
主要成果:
- 谷歌巴德在识别虚假睡眠神话方面取得了95.0%的准确率,而ChatGPT-4的准确率为85.0%.
- 谷歌巴德的评分显示,与睡眠专家的意见中等程度一致 (ICC=0.58为虚假,ICC=0.69为公共卫生意义).
- 谷歌巴德提供了更容易获取的内容 (八年级阅读水平),重点是实践建议,而ChatGPT-4则更加理论 (12年级阅读水平).
结论:
- 谷歌Bard显示了准确揭穿睡眠神话和公共卫生教育的巨大潜力.
- 人工智能工具在促进睡眠健康方面可能是有价值的,但需要仔细验证和与专家合作.
- 确保人工智能生成的可访问和可靠的健康信息对于有效的公共卫生活动至关重要.
相关概念视频
Non-equilibrium in the Cell
4.4K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
4.4K
Sleepwalking and Sleep Talking
158
Somnambulism, commonly known as sleepwalking, involves individuals engaging in activities ranging from simple walking to more complex behaviors such as driving. Sleepwalking typically occurs during the slow-wave sleep stages 3 and 4 early in the night when the person is not dreaming, contradicting the myth that sleepwalkers are acting out their dreams.
Factors that increase the likelihood of sleepwalking include sleep deprivation and alcohol consumption. Contrary to common beliefs, it is safe...
Factors that increase the likelihood of sleepwalking include sleep deprivation and alcohol consumption. Contrary to common beliefs, it is safe...
158
Understanding Sleep
228
Sleep, an essential biological state, involves significant reductions in physical activity, sensory awareness, and interaction with the environment. This complex physiological process is primarily regulated by specific brain regions, notably the hypothalamus and pons, which govern the sleep-wake cycle or circadian rhythm.
The circadian rhythm, a nearly 24-hour cycle, is deeply influenced by environmental light cues. Light exposure directly affects the hypothalamus, which in turn regulates...
The circadian rhythm, a nearly 24-hour cycle, is deeply influenced by environmental light cues. Light exposure directly affects the hypothalamus, which in turn regulates...
228
Sedatives and Hypnotics Drugs: Miscellaneous Agents
171
Sedatives and hypnotics encompass a wide range of substances, each with its unique mechanism of action, uses, and potential adverse effects.
Melatonin congeners like ramelteon (Rozerem) and tasimelteon (Hetlioz) selectively bind to melatonin receptors (MT1 and MT2) and thus mimic the actions of melatonin, a hormone that regulates sleep-wake cycles. Tasimelteon is primarily used for non-24-hour sleep-wake disorder, common in blind patients. They are also used to treat conditions like insomnia...
Melatonin congeners like ramelteon (Rozerem) and tasimelteon (Hetlioz) selectively bind to melatonin receptors (MT1 and MT2) and thus mimic the actions of melatonin, a hormone that regulates sleep-wake cycles. Tasimelteon is primarily used for non-24-hour sleep-wake disorder, common in blind patients. They are also used to treat conditions like insomnia...
171
Insufficient Sleep and Sleep Deprivation
141
Insufficient sleep refers to not getting the recommended amount of sleep for optimal functioning, even if it's just slightly less than needed. Sleep insufficiency may occur due to lifestyle choices, such as staying up late for social events or work, resulting in routinely getting less sleep than required. For example, consistently sleeping 6 hours when the body needs 7-9 hours can lead to cumulative effects on health and well-being.
Sleep deprivation is a more severe form of sleep loss...
Sleep deprivation is a more severe form of sleep loss...
141
REM Sleep Behavior Disorder
182
REM Sleep Behavior Disorder (RBD) is a sleep disorder characterized by the absence of muscle paralysis that normally occurs during the REM phase of sleep. This absence allows individuals to physically act out their dreams, which are often vivid and disturbing. Common behaviors exhibited during episodes include kicking, punching, and yelling. These actions can be dangerous, potentially leading to injuries for the person with RBD or their bed partner.
RBD is significantly associated with...
RBD is significantly associated with...
182


