Related Experiment Video
Updated: Jul 11, 2025
Prostate Organoid Cultures as Tools to Translate Genotypes and Mutational Profiles to Pharmacological Responses
Published on: October 24, 2019
Assessing the Performance of Chat Generative Pretrained Transformer (ChatGPT) in Answering Andrology-Related
Ufuk Caglar1, Oguzhan Yildiz1, M Fırat Ozervarli2
1Department of Urology, Haseki Training and Research Hospital, Istanbul, Turkey.
Objective:
The internet and social media have become primary sources of health information, with men frequently turning to these platforms before seeking professional help. Chat generative pretrained transformer (ChatGPT), an artificial intelligence model developed by OpenAI, has gained popularity as a natural language processing program. The present study evaluated the accuracy and reproducibility of ChatGPT's responses to andrology-related questions.
Methods:
The study analyzed frequently asked andrology questions from health forums, hospital websites, and social media platforms like YouTube and Instagram. Questions were categorized into topics like male hypogonadism, erectile dysfunction, etc. The European Association of Urology (EAU) guideline recommendations were also included. These questions were input into ChatGPT, and responses were evaluated by 3 experienced urologists who scored them on a scale of 1 to 4.
Results:
Out of 136 evaluated questions, 108 met the criteria. Of these, 87.9% received correct and adequate answers, 9.3% were correct but insufficient, and 3 responses contained both correct and incorrect information. No question was answered completely wrong. The highest correct answer rates were for disorders of ejaculation, penile curvature, and male hypogonadism. The EAU guideline-based questions achieved a correctness rate of 86.3%. The reproducibility of the answers was over 90%.
Conclusion:
The study found that ChatGPT provided accurate and reliable answers to over 80% of andrology-related questions. While limitations exist, such as potential outdated data and inability to understand emotional aspects, ChatGPT's potential in the health-care sector is promising. Collaborating with health-care professionals during artificial intelligence model development could enhance its reliability.
More Related Videos
03:14Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
08:38Renal Capsule Xenografting and Subcutaneous Pellet Implantation for the Evaluation of Prostate Carcinogenesis and Benign Prostatic Hyperplasia
Published on: August 28, 2013
Related Concept Videos
01:20Disorders of the Male Reproductive System
Prostate disorders are another major concern. These conditions can impair urinary flow due to the prostate's location around the urethra....
01:17Male Sexual Response: Erection & Ejaculation
The blood filling the erectile tissues compresses the veins, which helps to prevent blood from leaving...
01:19Testes: Gross Anatomy
Each testis is surrounded by the tunica albuginea, a dense connective tissue layer that provides structural support and protection. This layer is covered by an outer serous membrane called the tunica vaginalis, which helps reduce friction...
01:24Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...