相关实验视频
Updated: Jan 30, 2026

04:47
Multimodal Optical Imaging Platform for Studying Cellular Metabolism
Published on: June 6, 2025
1.1K
多模态大语言模型用于囊膜图像解释和膀损伤分类:比较研究
Yung-Chi Shih1, Cheng-Yang Wu2, Shi-Wei Huang2,3
1Division of Urology, Department of Surgery, Far Eastern Memorial Hospital, New Taipei City, Taiwan.
Journal of medical Internet research
|January 28, 2026
概括
多模式大语言模型 (MM-LLMs) 在解释囊镜图像方面表现有前途,有助于病变检测和活检决策. 然而,它们对复杂病例的诊断推理在临床使用中需要进一步改进.
科学领域:
- 人工智能在医学中的应用
- 医学成像分析 医学成像分析
- 泌尿器科 泌尿器科 泌尿器科 泌尿器科
背景情况:
- 囊镜是诊断膀病变的标准,但取决于操作者,可以忽略微妙的异常.
- 当前的人工智能系统缺乏解释能力和对囊镜检测结果的解释性报告.
- 多模式大型语言模型 (MM-LLM) 提供集成的视觉识别,推理和语言生成,以增强解释.
研究的目的:
- 评估最新的MM-LLM用于囊膜图像解释和病变分类.
- 用具有挑战性的,临床医生定义的数据集来评估诊断准确性,推理质量和临床相关性.
- 为了比较不同MM-LLM在特定诊断任务上的性能.
主要方法:
- 四个MM-LLM (OpenAI-o3,ChatGPT-4o,Gemini 2.5 Pro,MedGemma-27B) 在自由文本解释 (n=401) 和7类损伤分类 (n=113) 上进行了测试.
- 输出被盲目的评分员使用5分利克特级别来评分.
- 包括准确性,敏感性,特异性,Youden J和MCC在内的分类指标被计算为病变检测,活检指示和恶性病变.
主要成果:
- 在解剖学和发现解释方面,OpenAI-o3表现出强的表现,但在更高层次的推理和诊断方面遇到了困难.
- 对于临床相关的终点,OpenAI-o3获得了最平衡的性能,病变检测准确率为88.3%.
- 在7类分类中,OpenAI-o3的表现优于其他模型,特别是在恶性病变方面,尽管恶性病变的整体准确率为62.8%.
结论:
- MM-LLM显示出作为囊镜解释,活检分类和培训的辅助工具的巨大潜力.
- 目前MM-LLM在复杂差异诊断中的性能不佳,需要进一步优化.
- 临床整合需要进一步发展,以确保在诊断膀病变时的安全和可靠应用.
相关概念视频
Imaging Studies I: Kidney, Ureter, and Bladder Studies
344
Kidney, Ureter, and Bladder (KUB) StudiesKidney, Ureter, and Bladder (KUB) studies are standard diagnostic imaging procedures used to assess the anatomy of the urinary system. They are commonly utilized for patients experiencing abdominal pain or urinary symptoms. By using a simple X-ray of the abdomen, KUB studies can reveal structural and pathological abnormalities within the kidneys, ureters, and bladder. These studies are particularly valuable in diagnosing kidney stones, urinary...
344
Language
908
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
908
Urologic Endoscopic Procedure: Cystoscopic Examination
2.9K
Meaning of Cystoscopic Examination:Cystoscopy is an essential diagnostic tool in urology that is used to assess the structure and function of the genitourinary system. It provides a direct view of the urethra, bladder, and, in some cases, the ureteral openings. This procedure helps detect structural abnormalities, infections, cancers, and blockages in the urinary tract. There are two types of cystoscopy:Flexible cystoscopy is commonly performed in outpatient settings due to its less invasive...
2.9K
Components of Language
815
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
815
Language Development
908
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
908
Language and Cognition
797
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
797

