在混沌的边缘? 过度复杂性是人工通用智能的障碍
IEEE transactions on cybernetics
|September 22, 2025
概括
人工智能 (AI) 系统可能达到关键点,导致性能高原或不稳定,而不是一般智能 (AGI). 本研究介绍了检测这些AI系统过渡的方法,并提供了对AI扩展限制的见解.
科学领域:
- 复杂性理论 复杂性理论
- 人工智能的人工智能
- 计算系统 计算系统
背景情况:
- 传统的AI进步模型往往预测人工通用智能 (AGI) 的线性进步.
- 人工智能的系统复杂性增加并不总是与增强的能力相关,可能导致不稳定.
- 关键点或阶段过渡的概念为理解AI演变提供了一个替代的框架.
研究的目的:
- 通过复杂性理论探索AI系统的进展,挑战线性进步假设.
- 调查假设,不断增加的AI复杂性可能导致性能高原或在关键点的不稳定.
- 开发和验证用于检测AI系统中的关键过渡的方法.
主要方法:
- 基于代理的建模 (ABM) 用于模拟AI系统演变,基准性能作为复杂性代理.
- 模拟模拟了关键过渡期间的AI系统行为,从可预测的改进到不稳定的性能.
- 开发了一种基于随机梯度下降的启发式方法,并与CUSUM和Lyapunov指数技术进行比较,以检测不稳定性签名.
主要成果:
- 模拟显示了人工智能系统的关键过渡,其特点是从可预测的改进转向不稳定的行为.
- 开发的方法成功检测到各种不稳定性标志,包括突然转变和逐渐波动的坡.
- 在大型语言模型 (LLM) 中观察到的"破碎能力边界"被确定为由批判性强调的非线性现实世界的例子.
结论:
- 人工智能扩展可能会受到非线性性能边界和关键值的影响,而不是连续的线性进步.
- 经过验证的方法提供了一个实用的工具,用于监测AI系统的稳定性和识别潜在的关键过渡.
- 这项研究为评估人工智能安全性和理解人工通用智能的潜在局限性提供了新的理论视角和实践方法.
相关概念视频
Natural and Artificial Concepts
545
In psychology, concepts can be divided into two categories: natural and artificial. Natural concepts are formed through direct or indirect experiences. For example, consider the concept of snow. If you live in a place with regular snowfall, such as Essex Junction, Vermont, you know snow through direct experiences. You’ve seen it fall, touched it, shoveled it, and played in it. You recognize its texture, appearance, and even its smell. In contrast, if you live on an island like Saint...
545
Non-equilibrium in the Cell
5.3K
An important concept in studying metabolism and energy is that of chemical equilibrium. Most chemical reactions are reversible. They can proceed in both directions, releasing energy into their environment in one direction, and absorbing it from the environment in the other direction. The same is true for the chemical reactions involved in cell metabolism, such as the breaking down and building up of proteins into and from individual amino acids, respectively. Reactants within a closed system...
5.3K
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
292
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
292
Machines: Problem Solving II
648
Machines are complex structures consisting of movable, pin-connected multi-force members that work together to transmit forces. Consider a lifting tong carrying a 100 kg load. It comprises movable sections DAF and CBG linked together with member AB.
648
Machines: Problem Solving I
690
A toggle clamp is a mechanical device commonly used for holding and clamping objects in various applications, such as woodworking, metalworking, and assembly operations. Consider a toggle clamp subjected to a force of 200 N at the handle. The vertical clamping force can be calculated, provided the dimensions of the toggle clamp are known.
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
The toggle clamp system is a machine structure consisting of movable, pin-connected multi-force members that form a stabilized system to transmit forces. The...
690
Heuristics
657
Heuristics are problem-solving strategies that use mental shortcuts to simplify decision-making. Unlike algorithms, which must be followed precisely to achieve a correct result, heuristics offer a general problem-solving framework. They save time and energy but can sometimes lead to less rational decisions.
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
657


