EviD-GAN:通过无限的歧视因素以微不足道的成本来改进GAN
IEEE transactions on neural networks and learning systems
|August 19, 2024
概括
生成对抗网络的证据歧视器 (EviD-GAN) 学习模型和数据的不确定性,以微不足道的计算成本提高GAN性能. 这种方法提高了生成的样本质量,并优于现有的多差异化模型.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算机视觉 计算机视觉
背景情况:
- 合体学习增强了生成对抗网络 (GAN) 中的卷积神经网络 (CNN) 区分器,但增加了参数和计算负载.
- 对于GAN改进而言,优化歧视因子的最佳数量仍然是一个开放的研究问题.
- 现有的方法面临着计算开销和参数膨胀的挑战.
研究的目的:
- 为GANs (EviD-GAN) 提出一个证据歧视器,它既学习模型 (认识论) 和数据 (随机) 不确定性.
- 为了降低与GAN区分器中的集体学习相关的计算成本.
- 提高生成样本的质量和GAN培训的稳定性.
主要方法:
- 开发了一个证据歧视器,它对歧视器的输出施加了更高阶的分布约束,以模拟不确定性.
- 通过分析区分器输出分布和发电机性能之间的关系,制定了通用GAN框架.
- 引入了一个不对称的,样本级的规范化方案,灵感来自MMD排斥性GAN.
主要成果:
- EviD-GAN有效地学习了认识论和定量论的不确定性,以最小的计算成本模仿无限的歧视元组合.
- 与基线GAN相比,拟议的方法在频率初始距离 (FID) 和初始得分 (IS) 中实现了优异的性能.
- 实验结果表明EviD-GAN的成本效益和相对于竞争的多差别模型的持续改进.
结论:
- EviD-GAN提供了一种计算效率高的方法,通过将证据学习纳入不确定性估计来增强GAN.
- 该方法为发电机提供了信息化的梯度流,从而提高了样品质量和稳定性.
- EviD-GAN代表了GAN架构的重大进步,平衡了性能增长与计算可操作性.
相关概念视频
Generalization, Discrimination, and Extinction
498
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
498
Quantifying and Rejecting Outliers: The Grubbs Test
1.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
1.5K
Improving Translational Accuracy
9.6K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
9.6K
Routh-Hurwitz Criterion I
197
Consider an electrical power grid, where stability is essential to prevent blackouts. The Routh-Hurwitz criterion is a valuable tool for assessing system stability under varying load conditions or faults. By analyzing the closed-loop transfer function, the Routh-Hurwitz criterion helps determine whether the system remains stable.
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
To apply the Routh-Hurwitz criterion, a Routh table is constructed. The table's rows are labeled with powers of the complex frequency variable s, starting from the...
197
Routh-Hurwitz Criterion II
208
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
208
Law of Independent Assortment
55.2K
While Mendel’s Law of Segregation states that the two alleles for one gene are separated into different gametes, a different question of how different genes are inherited remains. For example, is the gene for tall plants inherited with the gene for green peas? Mendel asked this question by experimenting with a dihybrid cross; a cross in which both parents are homozygous for two distinct traits resulting in an F1 generation that are heterozygous for both traits.
55.2K


