聊天GPT-3.5与谷歌Bard:哪个大型语言模型最好响应常见的怀孕问题?
Keren Khromchenko1, Sameeha Shaikh2, Meghana Singh2
1Obstetrics and Gynecology, Hackensack Meridian Jersey Shore University Medical Center, Neptune, USA.
Cureus
|August 27, 2024
概括
谷歌双子座 (前Bard) 在回答怀孕问题方面表现优于ChatGPT-3.5,提供更准确的答案和更少的引用错误. 这两种大型语言模型都需要进一步评估女性健康信息的可靠性.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 产科和妇科 产科和妇科
背景情况:
- 大型语言模型 (LLM) 越来越多地用于健康信息,但它们在与怀孕有关的查询中的准确性尚不清楚.
- 评估像ChatGPT-3.5和Google Gemini这样的LLM的性能对于确保可靠的患者信息至关重要.
研究的目的:
- 为了对比ChatGPT-3.5和Google Gemini在常见怀孕问题上的准确性和参考验证.
- 评估这些LLM作为孕妇信息来源的可靠性.
主要方法:
- 在2023年8月,向ChatGPT-3.5和谷歌双子座提出了12个常见的怀孕问题.
- 答案和参考文献被单独评分,并根据正确性,完整性和对ACOG指南和PubMed证据的验证而达成共识.
- 引用被分类为经过验证,破碎,无关紧要,不存在或缺失.
主要成果:
- 谷歌双子实现了83%的可接受响应率 (10/12),而ChatGPT-3.5的可接受率为58% (7/12).
- 聊天GPT-3.5在100%的回复中表现出参考问题,而谷歌双子只有8% (1/12) 的回复存在差异.
- 在2023年5月至8月期间,ChatGPT-3.5的性能保持稳定,大约有50-58%的可接受响应.
结论:
- 在与怀孕相关的查询中,Google Gemini在准确性和引用完整性方面表现优于ChatGPT-3.5.
- 对于ChatGPT-3.5.5的参考验证,发现了重要的问题.
- 这两种LLM都需要进一步严格的评估和审查,才能被认为是孕妇可靠的资源.
更多相关视频
06:39Using a Murine Model of Psychosocial Stress in Pregnancy as a Translationally Relevant Paradigm for Psychiatric Disorders in Mothers and Infants
Published on: June 13, 2021
3.0K
05:33Author Spotlight: Alleviating Nausea and Vomiting in Pregnancy with Safe and Effective Auricular Acupuncture
Published on: August 4, 2023
1.3K
相关概念视频
Teratogenicity
2.4K
The ability of a drug to produce structural deformations and functional abnormalities in the developing embryo or the fetus is called teratogenicity, and the drug producing this effect is known as a teratogen. Teratogenic effects include stillbirth, miscarriage, intrauterine growth restriction, and neurocognitive delay. A teratogen may affect the embryo at different stages of development, which is important in determining the type and extent of the damage. During blastocyst formation, the early...
2.4K
Gonadal and Placental Hormones
1.4K
The gonads, namely the testes in males and the ovaries in females, are pivotal in producing gonadal hormones that orchestrate the intricate processes of sexual development and reproduction.
In males, testosterone is the primary gonadal androgen. It plays a central role in the maturation of male reproductive organs — the penis and testes. Additionally, testosterone is instrumental in the development of secondary sexual characteristics — a deep voice as well as facial and pubic hair...
In males, testosterone is the primary gonadal androgen. It plays a central role in the maturation of male reproductive organs — the penis and testes. Additionally, testosterone is instrumental in the development of secondary sexual characteristics — a deep voice as well as facial and pubic hair...
1.4K
Diabetes Mellitus: Type 2 and Gestational
2.3K
Type 2 diabetes, characterized by insulin resistance, arises when the insulin receptors on cells lose responsiveness to insulin, diminishing the cell's capacity to take up glucose, resulting in elevated blood glucose levels. To receive a diagnosis of Type 2 diabetes, a series of blood glucose tests are necessary to assess whether the blood glucose falls within normal parameters. If the result is out of the normal range, a patient may be diagnosed as prediabetic or diabetic, depending on the...
2.3K
Fetal Circulation
866
Fetal circulation is a unique system that facilitates the exchange of gases, nutrients, and waste products between the developing fetus and the mother. This intricate process takes place through a special organ called the placenta.
Two umbilical arteries transport blood from the fetus to the placenta. At the placenta, the blood absorbs oxygen and nutrients while simultaneously eliminating waste products. This oxygen-enriched and nutrient-rich blood then returns to the fetus through one...
Two umbilical arteries transport blood from the fetus to the placenta. At the placenta, the blood absorbs oxygen and nutrients while simultaneously eliminating waste products. This oxygen-enriched and nutrient-rich blood then returns to the fetus through one...
866
Fertilization
70.9K
During fertilization, an egg and sperm cell fuse to create a new diploid structure. In humans, the process occurs once the egg has been released from the ovary, and travels into the fallopian tubes. The process requires several key steps: 1) sperm present in the genital tract must locate the egg; 2) once there, sperm need to release enzymes to help them burrow through the protective zona pellucida of the egg; and 3) the membranes of a single sperm cell and egg must fuse, with the sperm...
70.9K
Hormones Regulating Blood Glucose
3.2K
Insulin is released by beta cells of the pancreas when blood glucose levels are high. It facilitates glucose absorption and utilization in insulin-dependent cells with insulin receptors on their plasma membranes. Insulin promotes glucose uptake by increasing the number of glucose transport proteins in the cell membrane, allowing glucose to enter the cell. As a result, glucose utilization and ATP production are enhanced.
In addition to accelerating glucose uptake and utilization, insulin has...
In addition to accelerating glucose uptake and utilization, insulin has...
3.2K
