在选定的数据中构建非歧视性算法
David Arnold1, Will Dobbie2, Peter Hull3
1University of California, San Diego and NBER.
概括
我们创建了新的工具,通过识别和纠正有偏见的数据输入来打击算法歧视. 我们的方法确保了更公平的算法,并提高了预测准确性,即使不完全的结果数据.
科学领域:
- 计算机科学 计算机科学
- 经济学 经济学 经济学
- 法律 法律 法律 法律
背景情况:
- 算法歧视发生在输入数据对具有相似潜在结果的个体有系统差异时.
- 结果的选择性可观察性使算法偏差的检测和缓解变得复杂.
研究的目的:
- 开发用于理解和消除算法歧视的准实验工具.
- 为选择性观察结果构建非歧视性算法.
- 通过解决数据差异来提高预测准确性.
主要方法:
- 开发了新的准实验方法来分析算法公平性.
- 与算法歧视相关的量化条件输入差异.
- 实施了衡量和消除这些差异的方法.
- 为了经验验证,利用了纽约市的准随机保释法官分配.
主要成果:
- 证实了算法歧视源于系统的输入差异.
- 证明测量和清除输入差异可以消除算法歧视.
- 通过更正的选择性可观测性来提高预测准确度.
- 在现实环境中验证了开发算法的有效性.
结论:
- 开发的准实验工具有效地识别和减轻算法歧视.
- 解决条件输入差异对于构建公平准确的算法至关重要.
- 该方法通过考虑选择性结果观察来提高预测性能.
相关概念视频
Stereotypes, Prejudice, and Discrimination
91.7K
Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who...
91.7K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
103
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
103
Stratified Sampling Method
13.0K
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest.
To choose a stratified sample, divide the population into groups called strata and then take a...
To choose a stratified sample, divide the population into groups called strata and then take a...
13.0K
Bias
5.5K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
5.5K
Quantifying and Rejecting Outliers: The Grubbs Test
2.2K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
2.2K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data
225
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
225


