从人工智能聊天机器人评估膀癌信息的可读性和质量:聊天GPT,谷歌双子座,Grok,Claude和DeepSeek之间的比较研究
Kunjan Patel1, Robert Radcliffe1
1Royal Derby Hospital, Derby DE22 3NE, UK.
Journal of clinical medicine
|November 13, 2025
概括
与其他AI聊天机器人相比,ChatGPT 4o在提供关于膀癌的可理解和高质量的信息方面表现出色. 它展示了卓越的可读性和专家评级的准确性,使其成为患者信息的可靠来源.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 泌尿器科 泌尿器科 泌尿器科 泌尿器科
背景情况:
- 患者越来越多地使用人工智能驱动的聊天机器人来获取健康信息,可能取代传统的搜索引擎.
- 评估人工智能产生的健康信息的质量和可读性对于患者的理解和安全至关重要.
- 通过人工智能聊天机器人访问的膀癌症信息需要对准确性和可访问性进行评估.
研究的目的:
- 评估领先的人工智能聊天机器人提供的膀癌信息的质量和可读性.
- 为了比较ChatGPT 4o,Google Gemini 2.0闪存,Grok 3,Claude Sonnet 3.7和DeepSeek R1.0的性能,我们可以使用它们进行比较.
- 用验证的可读性指数和专家临床判断来评估AI聊天机器人的响应.
主要方法:
- 通过谷歌趋势确定了十大膀癌症问题.
- 采集了五个人工智能聊天机器人的回应,使用自然语言查询.
- 分析了使用五个可读性指数 (FRE,FKRGL,枪雾,科尔曼-利乌,SMOG) 的答案.
- 两位咨询泌尿科医生使用DISCERN工具对信息质量进行了评价.
- 使用科恩的卡帕和ICC计算了评价者之间的协议.
主要成果:
- 聊天GPT 4o获得了最好的可读性分数 (FRE 59.4,年级水平7.0).
- 在可读性方面,Grok 3紧随其后 (FRE 58.3,年级8.7级).
- 克劳德3.7索内特表现出最复杂的语言 (FRE 44.9,年级9.5).
- 格洛克3获得了最高的DISCERN评分 (52.0),ChatGPT排在第四位 (50.5).
- 聊天GPT 4o显示了最高的互评分协议 (ICC:0.791).
结论:
- 所有评估的AI聊天机器人提供了通常高质量的膀癌信息,没有幻觉.
- 聊天GPT 4o成为总体表现最好的人,在可读性,专家评级和一致性方面表现出色.
- 人工智能聊天机器人为膀癌查询提供了一个有希望的,尽管可变的患者信息来源.
相关概念视频
Nursing Assessment of the Genitourinary System II: Inspection and Palpation
720
The nursing assessment of the genitourinary (GU) system involves a systematic inspection and palpation to identify abnormalities in the kidneys, bladder, and surrounding structures.InspectionMouth: Inspect for signs of kidney dysfunction, such as stomatitis (inflammation of the mouth) and ammonia breath, which may occur in advanced kidney disease due to the buildup of urea, breaking down into ammonia.Skin: Check for pallor, which could indicate anemia caused by kidney disease. Look for...
720
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
Cancer Prevention
7.6K
Several factors can increase the risk of cancer in an individual. About 50% of cancer cases can be prevented by adopting a healthy lifestyle, regular exercise, eating healthy, and following a modest cancer prevention diet. Epidemiological studies have consistently shown that populations with vegetable and fruit-rich diets have reduced the incidence of cancer. On the other hand, populations who have a diet rich in animal fat, red meat, junk food, or high calories are predisposed to cancer.
Some...
Some...
7.6K
Combination Therapies and Personalized Medicine
5.9K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
5.9K
Mouse Models of Cancer Study
6.4K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
6.4K
What is Cancer?
13.9K
Cells and tissues must meticulously coordinate their activities for the normal functioning of the human body. Therefore, they exhibit socially responsible behavior - resting, growing, dividing, differentiating, or dying - for the organism’s benefit. Cancer arises when cells divide uncontrollably and invade other tissues or organs.
Although people have known about cancer for centuries, it was only in 1761 that Giovanni Morgagni of Padua performed a detailed autopsy of...
Although people have known about cancer for centuries, it was only in 1761 that Giovanni Morgagni of Padua performed a detailed autopsy of...
13.9K


