Artificial intelligence in endocrine practice: comparing ChatGPT, Gemini, and Claude for adrenal incidentaloma care
View abstract on PubMed
Summary
This summary is machine-generated.Large language models (LLMs) show promise for managing adrenal incidentalomas, performing comparably in routine tasks but differing in complex scenarios. Careful model selection and human oversight are crucial for effective clinical integration in endocrinology.
Area Of Science
- Endocrinology
- Artificial Intelligence
- Medical Informatics
Background
- The clinical application of artificial intelligence (AI) is growing in endocrinology.
- The efficacy of large language models (LLMs) for managing adrenal incidentalomas is not well-established.
Purpose Of The Study
- To evaluate and compare the performance of four LLMs (ChatGPT-4o, ChatGPT-o1, Google Gemini 2.0, Claude 3.5) in addressing guideline-based queries and clinical scenarios related to adrenal incidentalomas.
Main Methods
- A cross-sectional study involving 34 guideline-derived questions and four case scenarios presented to four LLMs.
- Responses were evaluated by six endocrinologists using Likert scales for hallucination, quality, usability, reliability, and accuracy.
- Readability metrics and word counts were analyzed.
Main Results
- No significant performance differences were observed among LLMs for diagnosis, treatment/follow-up, and patient questions.
- ChatGPT-4o demonstrated superior performance over ChatGPT-o1 in complex cases, particularly in hallucination control, quality, and usability (p < 0.05).
- Readability analysis indicated high text complexity (Flesch-Kincaid Grade Level: 10.6-17.4), with excellent inter-rater reliability (ICC: 0.876-0.961).
Conclusions
- LLMs hold potential as decision-support tools in the management of adrenal incidentalomas.
- While LLM performance is similar for routine tasks, complex cases reveal significant differences, emphasizing the need for judicious model selection.
- Human oversight and attention to the readability of LLM-generated content are essential for endocrine practice.
Related Concept Videos
Adrenal gland disorders manifest when the production of adrenal hormones deviates from the norm, resulting in either excessive or insufficient concentrations.
Adrenal insufficiency, characterized by insufficient cortisol and aldosterone production, leads to conditions like Addison's disease. This disorder, affecting the adrenal cortex, exhibits symptoms such as skin bronzing, dehydration, low blood pressure, fatigue, and weight loss. Congenital adrenal hyperplasia, a genetic ailment causing...
Adrenal hormones play a pivotal role in maintaining the body's electrolyte balance and orchestrating responses to stress, showcasing the intricate functions of the adrenal cortex and medulla.
The adrenal cortex, a powerhouse of hormone synthesis, generates over two dozen corticosteroid hormones. The zona glomerulosa produces mineralocorticoids, exemplified by aldosterone, influencing the electrolyte composition of body fluids. The synthesis of glucocorticoids such as cortisol and...
The management of chronic pancreatitis is multifaceted, involving a comprehensive approach that includes thorough assessment, diagnostic testing, and a variety of management strategies.
Assessment:
Detailed History: Understanding the patient's symptoms is critical. It includes inquiring about abdominal pain, weight loss, and digestive issues, which are common in chronic pancreatitis.
Physical Examination: This might reveal abdominal tenderness, jaundice, and signs of malnutrition,...
The adrenal or supra-renal glands, situated above the kidneys and aligned with the twelfth rib, are paired pyramid-shaped structures crucial for the body's stress response. During stress, these glands secrete hormones vital for adaptive physiological reactions.
These glands possess a distinctive yellow tinge due to the stored cholesterol and fatty acids required for hormone synthesis. They are encased in a fibrous capsule and cushioned by fat.
The adrenal gland comprises two distinct...
The sympathetic pathways of the collateral ganglia and adrenal medulla serve unique but interconnected roles in the sympathetic response.
Collateral Ganglia
Sympathetic preganglionic axons reach the collateral ganglia along the route of splanchnic nerves. These nerves bypass the sympathetic trunk and communicate with sympathetic postganglionic neurons housed in the prevertebral ganglia. These ganglia supply the organs of the abdominopelvic cavity.
The greater splanchnic nerve, formed by the...
The small, pea-sized pituitary gland is located at the base of the brain. It is crucial in regulating various bodily functions, from growth to reproduction. The gland is divided into the anterior lobe and the posterior lobe. The secretory cell clusters in the pars distalis of the anterior pituitary lobe are controlled by hypothalamic regulators and synthesize six primary hormones.
The most abundantly secreted hormone from the anterior lobe is the growth hormone, which controls overall growth by...

