通过后置概率调整解决贝叶斯分类中的类不平衡问题
Vahid Nassiri1, Fetene Tekle2, Kanaka Tatikola2,3
1Open Analytics, Antwerp, Belgium.
Biometrical journal. Biometrische Zeitschrift
|November 18, 2024
概括
本研究提出了一种新的贝叶斯方法来解决机器学习中的类不平衡问题. 它根据训练数据表示调整类概率,减少对主导阶级的偏见.
科学领域:
- 机器学习 机器学习
- 统计建模 统计建模
- 数据科学数据科学数据科学
背景情况:
- 阶级不平衡是分类任务中的一个常见问题.
- 不平衡的数据集可能会导致对多数阶级的预测偏见.
- 现有的方法可能无法充分解决这种偏差.
研究的目的:
- 引入一个新的贝叶斯框架,以减轻来自不平衡数据集的偏差.
- 为了更准确的分类,调整后方概率.
- 提出一种方法,根据数据表示量化概率.
主要方法:
- 开发了一个简单的贝叶斯框架.
- 提出了一种新的概率缩放技术.
- 根据训练数据的比例调整后期概率.
主要成果:
- 拟议的方法有效地抵消因数据不平衡而导致的偏差.
- 后面的概率根据类表示进行缩放.
- 在不平衡的分类任务中实现了更平衡的预测.
结论:
- 新的贝叶斯框架为阶级不平衡提供了一个强有力的解决方案.
- 基于数据表示的后面概率的缩放是有效的.
- 这种方法可以提高不平衡数据集的分类准确性.
相关概念视频
Testing a Claim about Population Proportion
3.3K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.3K
Probability in Statistics
12.4K
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
12.4K
Binomial Probability Distribution
10.2K
A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
10.2K
Strategies for Assessing and Addressing Confounding
83
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
83
Poisson Probability Distribution
7.8K
A Poisson probability distribution is a discrete probability distribution. It gives the probability of a number of events occurring in a fixed interval of time or space if these events happen at a known average rate and independently of the time since the last event. For example, a book editor might be interested in the number of words spelled incorrectly in a particular book. It might be that, on average, there are five words spelled incorrectly in 100 pages. The interval is 100 pages.
The...
The...
7.8K
Probability Distributions
6.8K
The probability of a random variable x is the likelihood of its occurrence. A probability distribution represents the probabilities of a random variable using a formula, graph, or table. There are two types of probability distribution– discrete probability distribution and continuous probability distribution.
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
A discrete probability distribution is a probability distribution of discrete random variables. It can be categorized into binomial probability distribution and Poisson...
6.8K


