图形神经网络在身份效应学习中的泛化极限
Giuseppe Alessio D'Inverno1, Simone Brugiapaglia2, Mirco Ravanelli3
1DIISM - University of Siena, via Roma 56, Siena, 53100, Italy.
概括
图形神经网络 (GNN) 在未见数据上的身份任务中扎,特别是与直角编码. 然而,它们与Weisfeiler-Lehman (WL) 测试的连接为特定的图形结构提供了积极的结果.
科学领域:
- 机器学习 机器学习
- 图形理论 图形理论
- 人工智能的人工智能
背景情况:
- 图形神经网络 (GNN) 是用于图形数据分析的强大工具,通常使用消息传递机制.
- 它们的表达力与韦斯费勒-莱曼 (WL) 测试有关.
- 了解GNN概括对于语言学和化学中的应用至关重要.
研究的目的:
- 建立GNN的概括性质和基本限制,用于学习身份效应.
- 在简单的认知任务中研究GNN的能力.
- 分析两个字母单词和双循环图的性能.
主要方法:
- 对GNN概括性质的理论分析.
- 使用直角编码 (一热) 的两字母单词的案例研究.
- 对利用GNN-WL测试连接的双循环图的分析.
- 广泛的数值研究支持理论发现.
主要成果:
- 经过随机梯度下降训练的GNN无法将两个字母单词任务中的未见字母概括为直角编码.
- 在双循环图上,用GNN-WL测试等价值来证明GNN的积极存在结果.
- 该研究揭示了GNN在识别身份效应方面的特定局限性和能力.
结论:
- 在概括身份效应方面,GNN存在局限性,特别是在某些编码方法和任务方面.
- 与WL测试的等价性为理解特定图形结构上的GNN性能提供了理论基础.
- 需要进一步的研究来增强GNN对计算语言学和化学的认知任务的概括.
相关概念视频
Generalization, Discrimination, and Extinction
451
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
451
Cause and Effect
10.9K
While variables are sometimes correlated because one does cause the other, it could also be that some other factor, a confounding variable, is actually causing the systematic movement in our variables of interest. For instance, as sales in ice cream increase, so does the overall rate of crime. Is it possible that indulging in your favorite flavor of ice cream could send you on a crime spree? Or, after committing crime do you think you might decide to treat yourself to a cone?
10.9K
Case Studies
11.6K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.6K
The Representativeness Heuristic
15.8K
The representative heuristic describes a biased way of thinking, in which you unintentionally stereotype someone or something. For example, you may assume that your professors spend their free time reading books and engaging in intellectual conversation, because the idea of them spending their time playing volleyball or visiting an amusement park does not fit in with your stereotypes of professors.
15.8K
Associative Learning
300
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
300
Multiple Bar Graph
5.1K
As the name suggests, a multiple bar graph is the same as a bar graph but has multiple bars to depict relationships between different data values. One can include as many parameters as possible. However, each parameter must have the same unit of measurement.
Each bar or column in the multiple bar graph represents a data value. These graphs are used primarily in interrelating two or more sets of data. The categories of different kinds of data are listed along the horizontal or x-axis, whereas...
Each bar or column in the multiple bar graph represents a data value. These graphs are used primarily in interrelating two or more sets of data. The categories of different kinds of data are listed along the horizontal or x-axis, whereas...
5.1K


