交叉查看自我监督的异质图表表示学习学习
Danfeng Zhao1, Yanhao Chen1, Wei Song1
1College of Information Technology, Shanghai Ocean University, Shanghai, PR China.
概括
本研究引入了对异质图形神经网络 (HGNN) 的增强图形级交叉注意力机制,以改善多视图集成. 这种新的方法可以提高节点分类和集群任务的性能.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 图形神经网络的神经网络
背景情况:
- 异质图形神经网络 (HGNN) 难以整合多视图信息,限制了它们对复杂数据的有效性.
- 现有的方法往往无法充分利用异构图中的丰富结构和语义信息.
研究的目的:
- 为HGNN开发一个改进的图表级交叉注意力机制,以增强多视图集成.
- 提高模型在复杂,多视图异质网络数据上的表达力和性能.
主要方法:
- 整合了随机步行,卡茨索引和变形金刚来捕捉元路径视图中的更高阶语义关系.
- 在网络模式视图中利用网络分解和注意力机制来提取节点上下文.
- 采用了改进的图表级交叉注意力,用于跨视图的自适应特征融合,以及用于样本选择的对比损失函数.
主要成果:
- 提出的自我监督模型在节点分类和集群任务中表现出卓越的性能.
- 增强的交叉注意力机制有效地融合了多个视图的特征,提高了模型的表现力.
- 相反的损失函数通过利用本地和全球节点的中心性来增强模型的稳定性.
结论:
- 开发的图表级交叉注意力机制显著改善了HGNN中的多视图集成.
- 自主监督方法为利用复杂的异质图形数据提供了有效的解决方案.
- 该方法显示了需要先进节点分类和集群的应用程序的强大潜力.
相关概念视频
Vector Algebra: Graphical Method
14.2K
Vectors can be multiplied by scalars, added to other vectors, or subtracted from other vectors. The vector sum of two (or more) vectors is called the resultant vector or, for short, the resultant.
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
We use the laws of geometry to construct resultant vectors, followed by trigonometry to find vector magnitudes and directions. For a geometric construction of the sum of two vectors in a plane, we follow the parallelogram rule. Suppose two vectors are at arbitrary positions. Translate either one of...
14.2K
Associative Learning
605
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
605
Collisions in Multiple Dimensions: Problem Solving
4.4K
In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
4.4K
Collisions in Multiple Dimensions: Introduction
5.6K
It is far more common for collisions to occur in two dimensions; that is, the initial velocity vectors are neither parallel nor antiparallel to each other. Let's see what complications arise from this. The first idea is that momentum is a vector. Like all vectors, it can be expressed as a sum of perpendicular components (usually, though not always, an x-component and a y-component, and a z-component if necessary). Thus, when the statement of conservation of momentum is written for a...
5.6K
Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321
Introduction to Learning
551
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
551


