K-PathVQA:对于病理学的知识意识多模式表示视觉问题回答
IEEE journal of biomedical and health informatics
|July 11, 2023
概括
一种新的知识驱动方法用于病理学视觉问题答案 (PathVQA) 通过整合医学知识图表来显著提高准确性. 这种方法提高了计算机对复杂病理图像的理解,以更好地检测疾病.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 计算病理学计算病理学
背景情况:
- 病理成像对于疾病诊断和损伤评估至关重要.
- 病理学视觉问题答案 (PathVQA) 旨在通过病理学图像来解释临床发现.
- 现有的PathVQA方法往往缺乏外部知识,当图像数据不足时会限制性能.
研究的目的:
- 引入一种新的知识驱动的PathVQA (K-PathVQA) 系统.
- 通过整合外部医学知识图 (KG) 来增强PathVQA.
- 为了提高自动化病理图像分析的准确性和通用性.
主要方法:
- 开发了K-PathVQA,结合了医疗KG来丰富问题表示.
- 来自视觉,语言和知识来源的聚合嵌入,用于联合表示.
- 在公开的PathVQA数据集和单独的医疗VQA数据集上评估性能.
主要成果:
- 与基线方法相比,K-PathVQA实现了4.15%的整体准确度增加.
- 在开放式 (4.40%) 和封闭式 (1.03%) 两种类型的问题上都表现出显著的改善.
- 废弃性研究证实了单个成分的贡献,并验证了概括性.
结论:
- 整合医疗知识图表大大提高了PathVQA的绩效.
- K-PathVQA提供了一种更强大,更准确的方法来解释病理图像.
- 拟议的方法对推进病理学中计算机辅助诊断的前景充满希望.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
318
07:32Author Spotlight: Investigating Immune Cell Dynamics in the Tumor Microenvironment — Challenges and Innovations in Cancer Prognosis
Published on: April 12, 2024
1.4K
相关概念视频
ER Retrieval Pathway
3.9K
In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
3.9K
Classification of Illness
7.6K
The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.6K
Imaging Biological Samples with Optical Microscopy
4.9K
Optical microscopy uses optic principles to provide detailed images of samples. Antonie van Leeuwenhoek designed the first compound optical microscope in the 17th century to visualize blood cells, bacteria, and yeast cells. In 1830, Joseph Jackson Lister created an essentially modern light microscope. The 20th century saw the development of microscopes with enhanced magnification and resolution.
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
In optical microscopy, the specimen to be viewed is placed on a glass slide and clipped on the stage...
4.9K
Visual Agnosia
241
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round...
241
Glaucoma: Overview
623
Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...
623
Photoreceptors and Visual Pathways
6.1K
At the molecular level, visual signals trigger transformations in photopigment molecules, resulting in changes in the photoreceptor cell's membrane potential. The photon's energy level is denoted by its wavelength, with each specific wavelength of visible light associated with a distinct color. The spectral range of visible light, classified as electromagnetic radiation, spans from 380 to 720 nm. Electromagnetic radiation wavelengths exceeding 720 nm fall under the infrared category,...
6.1K
