关于场景理论,复杂性和基于压缩的学习和概括性的调查
IEEE transactions on neural networks and learning systems
|September 13, 2023
概括
与传统的PAC学习方法相比,场景理论为支持向量机 (SVM) 提供了更严格的概括误差边界. 这种方法为机器学习模型提供了更具信息性和可靠的性能保证.
科学领域:
- 机器学习 机器学习
- 统计学学习理论
- 优化理论 优化理论
背景情况:
- 支持矢量机器 (SVM) 广泛用于分类任务.
- 一般化误差极限对于理解模型可靠性至关重要.
- 可能大致正确 (PAC) 学习的现有界限具有局限性.
研究的目的:
- 使用场景理论研究 SVM 的泛化误差界限.
- 将场景理论界限与PAC学习界限进行比较.
- 推广场景理论作为SVM分析和模型选择的工具.
主要方法:
- 审查了场景理论的相关定理和假设.
- 开发了对有误差的紧密性和有效性的数值比较.
- 在来自现实生活问题的随机实验中使用支持向量分类器.
主要成果:
- 对于可实现的学习问题,场景理论的界限往往更为严格.
- 情景理论始终产生了信息性的概率界限.
- 从概念和实验角度对边界的有效性进行了比较.
结论:
- 场景理论为SVM的概括错误分析提供了一个有价值的替代方案.
- 场景理论可以帮助选择模型和最小化结构风险.
- 这项工作鼓励场景学和统计学学习理论社区之间的跨学科合作.
相关概念视频
Generalization, Discrimination, and Extinction
604
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
604
Cognitive Learning
307
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
307
Introduction to Learning
465
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
465
Ampere-Maxwell's Law: Problem-Solving
666
A parallel-plate capacitor with capacitance C, whose plates have area A and separation distance d, is connected to a resistor R and a battery of voltage V. The current starts to flow at t = 0. What is the displacement current between the capacitor plates at time t? From the properties of the capacitor, what is the corresponding real current?
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
To solve the problem, we can use the equations from the analysis of an RC circuit and Maxwell's version of Ampère's law.
For the first part of...
666
Surveys
14.8K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.8K
Observational Learning
207
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
207


