一种使用窗口统计的简单规范化技术,以改善医疗图像的分布外通用化
IEEE transactions on medical imaging
|January 15, 2024
概括
窗口规范化 (WIN) 改善了对异质医学图像的深度学习模型概括. 一种新的自蒸方法,WIN-WIN,进一步提高了分布外数据的性能.
科学领域:
- 医学成像分析 医学成像分析
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 卷积神经网络 (CNN) 经常在医学成像中与数据稀缺性和异质性作斗争,导致部署到新的临床场所时性能差.
- 将分布内 (IND) 和分布外 (OOD) 数据概括为AI模型可靠的临床应用至关重要.
研究的目的:
- 引入一个新的规范化技术,窗口规范化 (WIN),以提高CNN在异质医学图像上的概括能力.
- 提出一种自蒸方法,WIN-WIN,作为简单的延伸,以改善OOD的一般化.
主要方法:
- 窗口规范化 (WIN) 扰乱了在滑动窗口内使用本地统计数据的规范化统计数据,作为功能级增强.
- 在WIN-WIN技术的基础上,WIN-WIN方法采用了两个向前传递和自蒸的一致性约束.
- 这些方法在各种任务和数据集中进行了评估,以评估它们的普遍性和有效性.
主要成果:
- WIN显著改善了对异质医学图像的模型概括和规范化.
- WIN-WIN在分发之外的泛化方面取得了实质性的改进.
- 在6个任务和24个数据集中进行了广泛的实验,验证了拟议的方法的有效性.
结论:
- 窗口规范化 (WIN) 为医疗图像分析的现有规范化方法提供了一个简单而有效的替代方案.
- 这种WIN-WIN自蒸方法提供了一个简单而强大的扩展,用于提高模型的稳定性和OOD性能.
- 拟议的技术在解决医疗AI中的泛化挑战方面显示出广泛的适用性和有效性.
相关概念视频
Applications of Normal Distribution
5.1K
The normal distribution is a useful statistical tool. One of its practical applications is determining the door height after considering the normal distribution of heights of persons, such that many can pass through it easily without striking their heads. The normal distribution can also determine the probability of a person having a height less than a specific height.
The heights of 15 to 18-year-old males from Chile from 1984 to 1985 followed a normal distribution. The mean height is 172.36...
The heights of 15 to 18-year-old males from Chile from 1984 to 1985 followed a normal distribution. The mean height is 172.36...
5.1K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Normal Distribution
10.9K
The normal, a continuous distribution, is the most important of all the distributions. Its graph is a bell-shaped symmetrical curve, which is observed in almost all disciplines. Some of these include psychology, business, economics, the sciences, nursing, and, of course, mathematics. Some instructors may use the normal distribution to help determine students’ grades. Most IQ scores are normally distributed. Often real-estate prices fit a normal distribution. The normal distribution is...
10.9K
Central Limit Theorem
14.8K
The central limit theorem, abbreviated as clt, is one of the most powerful and useful ideas in all of statistics. The central limit theorem for sample means says that if you repeatedly draw samples of a given size and calculate their means, and create a histogram of those means, then the resulting histogram will tend to have an approximate normal bell shape. In other words, as sample sizes increase, the distribution of means follows the normal distribution more closely.
The sample size, n, that...
The sample size, n, that...
14.8K


