LoRA-PT:低级调整UNETR以使用主要张量单数值和向量进行海马细分
Guanghua He1, Wangang Cheng2, Hancan Zhu2
1Department of Mathematics, Hangzhou Dianzi University, Hangzhou 310018, China; School of Mathematics, Physics and Information, Shaoxing University, Shaoxing 312000, China.
Artificial intelligence in medicine
|September 5, 2025
概括
这项研究引入了LoRA-PT,一种用于海马细分的新参数高效微调方法. 它以较少的更新实现了高精度,解决了医学成像中的数据短缺问题.
科学领域:
- 神经成像
- 医学的人工智能
- 计算神经科学
背景情况:
- 精确的海马细分对于理解精神疾病至关重要.
- 深度学习模型提供先进的细分,但需要大量的资源和数据.
- 医疗图像细分通常面临有限的标记训练数据的挑战.
研究的目的:
- 开发一个参数有效的微调 (PEFT) 方法用于海马细分.
- 从BraTS2021数据集中适应预训练的UNETR模型用于海马细分.
- 克服医疗成像深度学习的计算成本和数据短缺的局限性.
主要方法:
- 建议使用LoRA-PT,这是一个新的PEFT技术.
- 利用张量奇数值分解从变压器参数矩阵创建低级张量.
- 微调只有低级张量,保持剩余张量固定.
主要成果:
- 与现有的PEFT方法相比,LoRA-PT显示出更高的细分精度.
- 显著减少了微调所需的参数更新数量.
- 在三个公开的海马数据集上得到验证.
结论:
- LoRA-PT为海马细分提供了高效有效的解决方案.
- 该方法成功地将知识从大型数据集转移到数据有限的任务中.
- 在神经成像分析中深度学习的应用.
相关概念视频
Base Quantities and Derived Quantities
20.9K
In any system of units, the units for some physical quantities must be specified through a measurement process. These measurements are the base quantities of the system, and their units are the base units of the system. The algebraic combinations of the base values can then be used to express all other physical quantities. Each of these physical quantities is then referred to as a derived quantity, with each unit being referred to as a derived unit.
The International Organization for...
The International Organization for...
20.9K
Estimation of the Physical Quantities
6.7K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
6.7K
Reducing Line Loss
530
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
530
Linear Approximation in Frequency Domain
503
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
503
Application of Linearization and Approximation
193
A drone flying through complex terrain often relies on more than one sensing method to estimate small changes in altitude. Along with direct measurements, air pressure provides a useful indirect indicator of vertical movement. Atmospheric pressure decreases as altitude increases, and this relationship is commonly described using an exponential model. Although accurate, converting pressure measurements into altitude values requires calculations that are too complex to perform repeatedly during...
193
Trapezoidal Rule
283
Estimating the distance traveled by a vehicle using its recorded velocity over time is a common problem in physics and engineering. When velocity data is available at discrete time intervals, rather than as a continuous function, numerical integration methods such as the trapezoidal rule are often employed to approximate the total displacement.The trapezoidal rule works by dividing the total time interval into several equal segments. Within each segment, the recorded velocities at the endpoints...
283


