减少幻觉和在生成性AI聊天机器人中对癌症的反应进行权衡信息:开发和评估研究
Sota Nishisako1, Takahiro Higashi1,2, Fumihiko Wakao3
1Institute for Cancer Control, National Cancer Center, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan, 81 3 3547 5201, 81 3 3547 8577.
JMIR cancer
|September 11, 2025
概括
提取增强生成 (RAG) 显著减少了生成性AI聊天机器人的幻觉,以获取癌症信息. 使用像癌症信息服务 (CIS) 这样的可靠来源对于公共卫生中准确的AI反应至关重要.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 公共卫生传播 公共卫生传播
背景情况:
- 生成型人工智能越来越多地用于信息检索,但对于癌症患者来说,准确性至关重要.
- 幻觉,或来自生成AI的不正确信息,在医疗保健环境中构成风险.
- 检索增强生成 (RAG) 在减少人工智能幻觉方面显示出希望,但需要进一步的现实世界评估.
研究的目的:
- 评估是否可靠来源的RAG可以降低癌症信息的生成AI聊天机器人的幻觉率.
- 为了比较RAG聊天机器人使用癌症特定数据与一般互联网搜索的性能.
- 评估不同大型语言模型 (LLM) 对幻觉率的影响.
主要方法:
- 开发了六种聊天机器人类型:GPT-4和GPT-3.5,使用癌症信息服务 (CIS) 数据,谷歌数据或没有参考数据 (传统).
- 编译了62个日本癌症相关问题,并自动生成答案.
- 临床医生审查了对幻觉 (医学上有害的错误信息) 的反应,并使用统计模型对聊天机器人类型的比率进行比较.
主要成果:
- 使用CIS数据的聊天机器人比使用谷歌数据 (6-10%) 或传统聊天机器人 (~40%) 的聊天机器人有较低的幻觉率 (0-6%).
- 与谷歌数据 (OR 9.4) 和传统聊天机器人 (OR 16.1) 相比,使用CIS数据的RAG显著减少了幻觉.
- 与传统聊天机器人不同,RAG聊天机器人有时拒绝在信息无法获得时回答,这表明他们有更好的能力承认信息缺口.
结论:
- 当使用可靠的癌症特定信息来源时,RAG显著降低了生成AI幻觉率.
- 这种技术通过提高准确性和承认信息局限性,提高了人工智能适用于公共卫生沟通的适用性.
- 使用可靠数据源实施RAG对于可靠的AI驱动的健康信息传播至关重要.
相关概念视频
Mouse Models of Cancer Study
6.4K
Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...
6.4K
Cancer Therapies
9.8K
Cancer therapies are various modes of treatment, such as surgery, radiation therapy, and chemotherapy that are administered to cancer patients.
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
However, cancer treatments can pose several challenges, as therapies used to kill cancer cells are generally also toxic to normal cells. Moreover, cancer cells mutate rapidly and can develop resistance to chemical agents or radiation therapy. Besides, all types of cancer cells may not respond to the same therapy. Some cancer cells respond to one...
9.8K
Adaptive Mechanisms in Cancer Cells
7.0K
Cancer cells accumulate genetic changes at an abnormally rapid rate due to the defects in the DNA repair mechanisms. From an evolutionary perspective, such genetic instability is advantageous for cancer development. Mutant cell lines accumulate a series of beneficial mutations that contribute to their progression into cancer.
Some of the advantages that cancer cells have on normal cells include - enhanced ability to divide without terminally differentiating, induce new blood vessel formation,...
Some of the advantages that cancer cells have on normal cells include - enhanced ability to divide without terminally differentiating, induce new blood vessel formation,...
7.0K
Combination Therapies and Personalized Medicine
5.9K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
5.9K
Tumor Immunotherapy
1.8K
Immunotherapy is a treatment that boosts or manipulates the immune system to fight diseases, including cancer. For instance, by stimulating an immune response through vaccinations against viruses that cause cancers, like hepatitis B virus and human papillomavirus, these diseases can be prevented. Nonetheless, some cancer cells can avoid the immune system due to their rapid mutation and division. The immune response to many cancers involves three phases: elimination, equilibrium, and escape.
1.8K
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K

