视觉引导的多模式融合:使用可解释的人工智能实现适应式学习框架
Sahar Moradizeyveh1,2, Ambreen Hanif2, Sidong Liu1
1Computational NeuroSurgery (CNS) Lab, Macquarie Medical School, Faculty of Medicine, Health and Human Sciences, Macquarie University, Sydney 2113, Australia.
Sensors (Basel, Switzerland)
|August 14, 2025
概括
这项研究引入了一种使用眼睛追踪指导医学图像解释的AI框架,通过分析胸部X射线 (CXR) 中的视觉注意力模式来提高诊断准确性和为放射科医生培训.
科学领域:
- 医疗成像医学成像
- 人工智能的人工智能
- 放射学培训 放射学培训
背景情况:
- 对初学者放射科医生来说,解释诊断成像是具有挑战性的,因为缺乏结构化的指导和专家反.
- 在医学图像中识别临床相关特征需要大量的专业知识,并且可能是一项艰巨的任务.
研究的目的:
- 开发和验证一个眼神导向多模式融合框架,以加强医学图像解释方面的学习和决策.
- 利用专家眼睛跟踪数据来提高放射学中AI模型的准确性和可解释性.
主要方法:
- 集成的胸部X射线 (CXR) 图像与专家的固定地图,以捕捉视觉注意力模式.
- 利用共享的骨干架构,共同处理图像和目光数据,最大限度地减少固定数据中的噪声.
- 使用梯度加权类激活映射 (Grad-CAM) 进行解释性验证和评估分类性能和解释调整.
主要成果:
- 眼神导向多模式融合框架在提高模型可靠性和可解释性方面表现出有效性.
- 评估证实了框架在视线噪音下的稳定性,并与专家注释保持一致.
- 该系统成功地突出了基于专家视觉关注的精确诊断关键的感兴趣区域 (ROI).
结论:
- 拟议的框架为医疗成像的智能,以人为中心的人工智能系统提供了一个有前途的途径.
- 这种方法既支持诊断的准确性,也提高了放射科医生的医疗培训.
- 整合专家眼睛跟踪数据为人工智能驱动的医学图像分析提供了宝贵的见解.
相关概念视频
Observational Learning
312
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
312
Association Areas of the Cortex
6.3K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
6.3K
Associative Learning
575
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
575
Multi-input and Multi-variable systems
149
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
149
Vision
55.3K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
55.3K
Introduction to Learning
532
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
532


