自主监督的超图训练框架通过结构意识的学习
概括
本研究介绍了一种新的自我监督超图训练框架 (SS-HT),以改善对超图的自我监督学习 (SSL). SS-HT增强了特征重建和结构分析,优于现有方法,减少了数据标签需求.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 网络科学 网络科学
背景情况:
- 传统的图表难以处理复杂的,超出对比的相关性.
- 将超图集成到自主监督学习 (SSL) 中具有挑战性,原因是高阶结构变化.
研究的目的:
- 通过结构意识学习 (SS-HT) 引入自我监督的超图训练框架.
- 提高对SSL的超图的结构变化的感知和测量.
- 改进高图神经网络 (HGNN) 中的特征重建和结构距离计算.
主要方法:
- 在HGNNs中使用"掩盖和重新掩盖"策略进行特征重建.
- 引入了用于有效计算局部高阶相关性变化的度量策略.
- 使用11个数据集的广泛实验来验证性能.
主要成果:
- 在低级和高级数据上,SS-HT在现有SSL方法上表现出优越的性能.
- 在下游任务微调中,只用1%的标记数据 (Cora-CC数据集) 实现了比HGNN的32%的改进.
- 显著减少对数据标签的依赖.
结论:
- SS-HT是一种基于超图的SSL的强大且可扩展的框架.
- 它有效地提高了各种HGNN方法的性能.
- 该框架在需要复杂的关系数据分析的现实场景中具有强大的适用性.
相关概念视频
Survival Tree
160
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
160
Introduction to Learning
533
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
533
Observational Learning
314
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
314
Associative Learning
579
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
579
Purposive Learning
207
E. C. Tolman emphasized the purposiveness of behavior — the idea that much of our behavior is goal-directed. For instance, employees who aim for a promotion work diligently to meet their targets. Tolman argued that when classical conditioning and operant conditioning occur, the organism acquires certain expectations. In classical conditioning, a child might fear a dog because they expect it to bite. In operant conditioning, a person might consistently work overtime because they expect a...
207
Avoidance Learning and Learned Helplessness
1.9K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
1.9K

