基于高斯合软max层的生成和歧视模型的混合
IEEE transactions on neural networks and learning systems
|February 6, 2024
概括
本研究介绍了一种新的混合神经网络 (NN) 模型,该模型结合了生成和歧视方法. 新的高斯联软max层通过估计数据和类分布来实现更好的分类,增强半监督学习和信心校准.
科学领域:
- 机器学习 机器学习
- 人工智能的人工智能
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 生成模型提供了诸如无监督数据访问和对分类进行校准的信心等好处.
- 歧视性模型在性能上表现出色,结构和算法更简单.
- 在将生成方法和歧视方法的优势结合在一起的模型中存在差距.
研究的目的:
- 提出一种新的方法来训练在单个神经网络中的混合歧视生成模型.
- 开发一个统一的架构,利用生成式和歧视式学习模式的优势.
- 通过能够估计数据和类后部分布的模型来增强分类任务.
主要方法:
- 介绍了高斯联软max层,这是神经网络的一个新型组件.
- 将高斯联软max层嵌入到神经网络分类器中.
- 使用该层共同估计输入数据分布和类后面概率.
主要成果:
- 拟议的混合模型成功地整合了生成性和歧视性特征.
- 该模型展示了估计数据和类后部分布的能力.
- 混合方法在半监督学习场景中显示了适用性.
- 该方法有助于在分类任务中改进信心校准.
结论:
- 开发的混合模型通过结合生成性和歧视性优势,为分类提供了协同作用的方法.
- 斯合软max层是一个关键的创新,使联合分布估计成为可能.
- 拟议的方法推进了半监督学习,并增强了模型信心校准.
相关概念视频
Generalization, Discrimination, and Extinction
559
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
559
Multi-input and Multi-variable systems
106
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
106
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
69
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
69
Hybrid Zones
17.0K
Hybrid zones are narrow regions where two closely related species interact, mate, and produce hybrids. Relative to either parent species, hybrids may possess distinct phenotypic or genetic differences that impact their survival and reproductive success. The genetic variances introduced by hybridization influence species diversity and speciation processes within the hybrid zone.
17.0K
Typical Model Studies
359
Fluid mechanics model studies often utilize scaled-down systems to predict fluid behavior in full-scale environments, such as river flows, dam spillways, and structures interacting with open surfaces. Maintaining Froude number similarity in river models is crucial, as it replicates surface flow features like wave patterns and velocities.
359
Multicompartment Models: Overview
143
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
143


