实例特定模型扰动改善了通用化的零射击学习
Guanyu Yang1, Kaizhu Huang2, Rui Zhang3
1Data Science Research Center, Duke Kunshan University, Kunshan, 215316, China guanyu.yang@dukekunshan.edu.cn.
Neural computation
|March 8, 2024
概括
这项研究引入了一种新的对抗性训练方法,以改善通用零射击学习 (GZSL). 该方法通过使预测对未见类更敏感,同时保持可见类的稳定性来提高模型准确性.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 机器学习 机器学习
背景情况:
- 一般化零射击学习 (GZSL) 旨在分类可见和不可见的数据类别.
- 现有的GZSL模型往往过度适应已见类,错误地分类未见数据.
- 一个关键的挑战是平衡已见类的识别与对新鲜,未见类的敏感性.
研究的目的:
- 开发一个强大的框架,用于通用零射击学习 (GZSL).
- 为了减轻GZSL模型过度调整培训数据和错误分类未见类的趋势.
- 为了提高ZSL任务中可见和不可见类的准确预测.
主要方法:
- 实施了一个参数智能的对抗性训练过程,以进行可见类的强有力的识别.
- 在测试期间引入了一种新的模型扰动机制,以增加对未见类的灵敏度.
- 从多个个体同时计算参数扰动,以避免对预测产生极端,有害的影响.
主要成果:
- 拟议的框架证明了使用学习指标的零射击学习方法的有效改进.
- 在测试过程中,对抗性扰动成功地将预测偏向于未见的类.
- 强有力的培训确保了可见类的预测在很大程度上不受影响,这表明模型稳定性得到了改善.
结论:
- 开发的对抗训练和干扰策略显著提高了GZSL的业绩.
- 该方法通过改善未见的类识别,有效地解决了GZSL中的过拟合问题.
- 这种方法为推进人工智能的零射击学习能力提供了一个有希望的方向.
相关概念视频
Stereotype Content Model
14.7K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.7K
Mechanistic Models: Compartment Models in Individual and Population Analysis
40
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
40
Observational Learning
171
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
171
Modeling in Therapy
72
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
72
Linear Approximation in Time Domain
81
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
81
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
54
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
54


