Related Experiment Video
Updated: Sep 9, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Evaluating artificial intelligence chatbots' responses to gynecomastia inquiries: Comparative study of information
Xinran Shao1, Ting Ruan2, Xingai Ju3
1Department of Thyroid and Breast Surgery, People's Hospital of China Medical University, Shenyang, Liaoning, China.
Background:
With the rapid development of artificial intelligence (AI) technologies, AI chatbots have been widely applied in the healthcare to provide patients with immediate information. Many people feel embarrassed to discuss gynecomastia in person and turn to online resources for support.
Objective:
This study aims to fill this gap by evaluating the performance of five popular AI chatbots (ChatGPT, DeepSeek, Gemini, Perplexity, and Copilot) in answering questions about gynecomastia, focusing on their reliability, quality, readability, and guideline consistency.
Methods:
In this study, the top 25 gynecomastia-related queries searched globally from 2004 to 2025 were retrieved from Google Trends and input into five AI chatbots for responses. The reliability and quality of responses were assessed using the DISCERN questionnaire and the Ensuring Quality Information for Patients (EQIP) tool. Readability was analyzed via the Flesch-Kincaid Grade Level (FKGL) and Flesch-Kincaid Reading Ease Score (FKRE). Accuracy, supplementary, and incompleteness were compared with the European Association of Andrology guidelines.
Results:
Copilot had the lowest DISCERN score (median [interquartile range (IQR)]: 41.5[36.0-45.0]), while DeepSeek performed best in EQIP scoring (median [IQR]: 60.4[59.0-64.1]). For readability, ChatGPT exhibited the highest FKGL score (mean ± standard deviation (SD): 15.1 ± 2.0) but the lowest FKRE score (mean ± SD: 15.1 ± 2.0), indicating the poorest readability. In contrast, DeepSeek achieved the lowest FKGL (mean ± SD: 11.0 ± 1.2), suggesting superior readability. Guideline consistency analysis revealed an overall accuracy of 85.71% for AI responses, but key details were often omitted.
Conclusion:
AI chatbots provide immediate informational support for gynecomastia patients, but there is significant variability in readability and reliability, alongside risks of omitting guideline content.
More Related Videos
Related Concept Videos
Regulation of Hormone Secretion
Humoral...
Hormones of the Pituitary Gland
The most abundantly secreted hormone from the anterior lobe is the growth hormone, which controls overall growth by...
Hormonal Regulation
Bioequivalence: Overview
Hormones of the Adrenal Glands
The adrenal cortex, a powerhouse of hormone synthesis, generates over two dozen corticosteroid hormones. The zona glomerulosa produces mineralocorticoids, exemplified by aldosterone, influencing the electrolyte composition of body fluids. The synthesis of glucocorticoids such as cortisol and...
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:

