人工智能模型在递归生成的数据上训练时会崩
Ilia Shumailov1, Zakhar Shumaylov2, Yiren Zhao3
1OATML, Department of Computer Science, University of Oxford, Oxford, UK. ilia.shumailov@chch.ox.ac.uk.
Nature
|July 24, 2024
概括
在自身输出上训练的生成人工智能 (AI) 模型可能会出现不可逆转的缺陷,这种现象被称为模型崩. 这会影响未来人工智能产生的内容的质量和多样性.
科学领域:
- 人工智能
- 机器学习
- 生成模型
背景情况:
- 包括GPT-4等大型语言模型 (LLM) 和稳定扩散等图像生成模型在内的生成人工智能 (AI) 正在迅速改变在线内容.
- 人工智能生成文本和图像的广泛使用引发了对用于训练这些模型的数据未来的质疑.
- 之前的AI进步,如GPT-2,GPT-3和GPT-4,已经在各种语言任务中表现出了显著的能力.
研究的目的:
- 研究大型语言模型 (LLM) 对未来人工智能培训数据的潜在影响.
- 识别和分析人工智能模型在模型生成的内容上训练时出现的缺陷.
- 了解这些缺陷对人工智能发展的可持续性和各种数据源的价值的影响.
主要方法:
- 理论分析生成模型,包括LLM,变化自编码器 (VAE) 和高斯混合模型 (GMM).
- 模拟和实证研究以证明模型崩的发生和影响.
- 当模型在合成数据上训练时,对数据分布损失的调查会停止.
主要成果:
- 在培训中不分青红白地使用模型生成的内容会导致人工智能模型的不可逆转缺陷.
- 这种被称为"模型崩"的现象导致了原始数据分布的尾部消失.
- 模型崩是各种类型的生成模型中普遍存在的问题,包括LLM,VAE和GMM.
结论:
- 模型崩对人工智能产生的内容的长期质量和多样性构成重大威胁.
- 保持对大规模网络数据培训的好处需要解决模型崩问题.
- 反映真实的人际交互的数据将越来越有价值, 作为人工智能培训模式崩的对策.
相关概念视频
Survival Tree
75
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
75
Clearance Models: Compartment Models
64
Clearance measures drug elimination from the central compartment, including plasma and highly perfused organs like kidneys and liver. Its calculation varies depending on pharmacokinetic models and administration routes. The one-compartment model, for instance, portrays the pharmacokinetics of polar drugs such as aminoglycoside antibiotics administered intravenously and readily excreted in urine. In this case, clearance is influenced by the terminal rate constant (λz) and the total volume...
64
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
47
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
47
Collisions in Multiple Dimensions: Problem Solving
3.7K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
3.7K
Multicompartment Models: Overview
121
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
121
Per-Unit Sequence Models
73
An ideal Y-Y transformer, grounded through neutral impedances, displays per-unit sequence networks akin to those of a single-phase ideal transformer when subjected to balanced positive- or negative-sequence currents. These currents do not produce neutral currents, and their associated voltage drops.
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
Zero-sequence currents, which are identical in magnitude and phase, generate a neutral current, resulting in voltage drops across the neutral impedance and the low-voltage winding. If the...
73


