数据集-学习二元性和新兴的关键性
Ekaterina Kukleva1, Vitaly Vanchurin1,2
1Artificial Neural Computing, Weston, FL 33332, USA.
Entropy (Basel, Switzerland)
|September 27, 2025
概括
我们在人工神经网络中发现了一个数据集-学习二元性,将数据集与学习动态联系起来. 这种二元性有助于解释训练过程中如何出现关键性,即使是从非关键数据中.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 计算神经科学是一种神经科学.
背景情况:
- 人工神经网络 (ANN) 涉及可训练变量 (权重,偏差) 和不可训练变量 (激活,数据) 之间的复杂相互作用.
- 了解数据属性和学习动态之间的关系对于优化ANN性能和可解释性至关重要.
研究的目的:
- 建立和探索数据集与ANN中可训练变量的学习动态之间的数学二元性.
- 通过使用这种二元性来研究ANN学习中批判性 (权力-规律分布) 的出现.
- 分析激活和丢失函数如何影响学习的关键性.
主要方法:
- 通过编写激活和学习传递 (例如,向前和向后传播) 制定了一个"数据集-学习二元性".
- 在学习平衡的玩具和大规模ANN模型中分析了这种二元性.
- 研究了修改激活和损失函数对新出现的权力定律分布的影响.
主要成果:
- 在非可训练边界变量 (数据集) 和可训练变量 (学习) 之间展示了一个复杂的非线性二元地图.
- 表明在学习系统中,即使数据集处于非关键状态,也可能出现关键性.
- 证实可训练变量波动的功率定律分布可以通过改变激活或损失函数来改变.
结论:
- 数据集-学习二元性为理解ANN学习动态和新出现的属性提供了一个新的框架.
- 在ANN中,关键性不仅取决于数据集,还取决于网络架构和学习规则.
- 这种二元性为复杂的神经系统中控制和预测学习行为提供了洞察力.
相关概念视频
Woodward–Hoffmann Selection Rules and Microscopic Reversibility
3.8K
Electrocyclic reactions, cycloadditions, and sigmatropic rearrangements are concerted pericyclic reactions that proceed via a cyclic transition state. These reactions are stereospecific and regioselective. The stereochemistry of the products depends on the symmetry characteristics of the interacting orbitals and the reaction conditions. Accordingly, pericyclic reactions are classified as either symmetry-allowed or symmetry-forbidden. Woodward and Hoffmann presented the selection criteria for...
3.8K
Generalization, Discrimination, and Extinction
1.3K
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
1.3K
Observational Learning
838
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
838
Associative Learning
1.2K
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
1.2K
Multi-input and Multi-variable systems
392
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
392
Collisions in Multiple Dimensions: Problem Solving
5.3K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
5.3K

