模仿SPR:清洁的样本选择在学习与噪音标签.
IEEE transactions on pattern analysis and machine intelligence
|December 1, 2023
概括
这项研究引入了一个新的框架,用于识别用于训练神经网络的清洁数据,提高模型性能. 淘汰-SPR方法可证明可以控制清洁样品选择中的错误,提高稳定性.
科学领域:
- 机器学习 机器学习
- 计算机科学 计算机科学
- 统计 统计 统计 统计
背景情况:
- 噪音训练数据集会降低神经网络的概括性和稳定性.
- 准确识别干净样品对于有效的模型培训至关重要.
- 现有的方法可能在一般情况下难以识别清洁数据.
研究的目的:
- 提出一个理论上有保障的框架,用于清洁的样本选择在学习与噪音标签.
- 开发一种数据适应方法来控制错误选择率 (FSR).
- 提高清洁样本选择过程的可扩展性和效率.
主要方法:
- 引入可扩展的惩罚回归 (SPR) 来建模特征标签关系并识别清洁数据.
- 开发了Knockoffs-SPR,这是SPR的数据适应扩展,具有可证明的FSR控制.
- 实现了用于并行处理的分割算法,以实现大数据集的可扩展性.
- 集成的Knockoffs-SPR与半监督的算法,以利用噪音数据作为未标记的数据.
主要成果:
- 在理论上,SPR在特定条件下识别清洁数据.
- 假冒SPR有效地控制FSR,减少噪音数据的错误选择.
- 分解算法确保了框架对大型数据集的可扩展性.
- 实验结果证明了该框架在基准和现实世界杂数据集上的有效性.
结论:
- 拟议的Knockoffs-SPR框架为使用噪音标签的学习提供了理论上健全和实际上有效的解决方案.
- 与半监督学习的整合进一步提高了噪音数据的实用性.
- 开发的方法显著提高了在不完美的数据集上训练的神经网络的稳定性和通用性.
相关概念视频
Quantifying and Rejecting Outliers: The Grubbs Test
1.6K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.6K
Sampling Methods: Sample Types
230
Sampling materials are classified into three main types: solid, liquid, and gas.
Solid samples include a variety of substances, such as sediments from water bodies, soil, metals, and biological tissues. Two standard methods for extracting sediments from water bodies are grab sampling and piston coring. Grab sampling involves using a device to collect a discrete sediment sample from the bottom of a water body with minimal disturbance. Grab samples do not always represent the entire area due to...
Solid samples include a variety of substances, such as sediments from water bodies, soil, metals, and biological tissues. Two standard methods for extracting sediments from water bodies are grab sampling and piston coring. Grab sampling involves using a device to collect a discrete sediment sample from the bottom of a water body with minimal disturbance. Grab samples do not always represent the entire area due to...
230
Random Sampling Method
11.2K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
11.2K
Sampling Methods: Overview
331
A sample refers to a smaller subset representative of a larger population. In analytical chemistry, studying or analyzing an entire population is often impractical or impossible. Therefore, samples are used to draw inferences and generalize the whole population. The sampling method selects individuals or items from a population to create a sample. Standard sampling methods include random, judgemental, systematic, stratified, and cluster sampling.
In analytical chemistry, the choice of...
In analytical chemistry, the choice of...
331
Cluster Sampling Method
11.9K
Appropriate sampling methods ensure that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
11.9K
Sampling Distribution
12.8K
Given simple random samples of size n from a given population with a measured characteristic such as mean, proportion, or standard deviation for each sample, the probability distribution of all the measured characteristics is called a sampling distribution. How much the statistic varies from one sample to another is known as the sampling variability of a statistic. You typically measure the sampling variability of a statistic by its standard error. The standard error of the mean is an example...
12.8K


