极地对比注意力和跳过跨道聚合,以在U-Net中高效学习
1Department of Computing Science, University of Aberdeen, Aberdeen, AB24 3UE, United Kingdom.
Computers in biology and medicine
|August 25, 2024
概括
一种新的轻量级病变细分模型使用极变换和新的注意力机制来进行高效的医学图像分析. 它在移动设备上以最小的参数实现了最先进的性能.
科学领域:
- 医学图像分析 医学图像分析
- 计算机视觉 计算机视觉
- 机器学习 机器学习
背景情况:
- 现有的损伤细分模型需要大量的计算资源,限制了它们在边缘设备上的使用.
- 注意力的进步,跳过连接和深度监督增加了计算复杂性.
- 需要在智能手机和照顾点设备上部署高效的模型.
研究的目的:
- 开发一个轻量级和计算效率高的损伤语义细分模型.
- 在资源有限的设备上改进病变细分的性能.
- 为了实现低参数数量的高精度.
主要方法:
- 引入了极变换来简化图像数据以实现更快的处理.
- 使用哈达马德产品开发了一种学习效率高的基于极点的对比注意力 (PCA) 机制.
- 实现了一种新的跳过跨通道聚合 (SC^2A) 与高斯深度卷积.
主要成果:
- 该模型在约25K参数的ISIC 2018和Kvasir数据集上实现了最先进的性能.
- 在各种数据集 (PH^2,CVC-Polyp) 中表现出强大的概括性.
- 在移动设置中,在 IoU,子得分和运行时间方面表现优于其他轻量级型号.
结论:
- 拟议的模型为病变细分提供了高效和准确的解决方案.
- 它的低计算要求使其适合在边缘和移动设备上部署.
- 这项工作在资源有限的临床环境中推进了先进的医学图像分析的可行性.
相关概念视频
Propagation of Action Potentials
The propagation of an action potential refers to the process by which a nerve impulse, or "action potential," travels along a neuron.
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neurons (nerve cells) have a resting membrane potential, with a slightly negative charge inside compared to outside. This is maintained by ion channels, such as sodium (Na+) and potassium (K+) channels, which control the flow of ions. When a stimulus, like a touch or a signal from another neuron, triggers the neuron, sodium channels open, allowing sodium ions to...
Neural Circuits
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Multi-input and Multi-variable systems
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
Introduction to Learning
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
Associative Learning
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
Cognitive Learning
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...


