图形神经网络的分层训练与自主监督学习
概括
层 wise 规则化图形infomax (LRGI) 能够在大型图形上高效地训练图形神经网络 (GNN). 这种自我监督的方法通过独立处理层来扩展GNN训练,减少内存和计算需求.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 图形神经网络的神经网络
背景情况:
- 在大型图形上训练图形神经网络 (GNN) 带来了重大的记忆和计算挑战.
- 详细的节点级注释的稀缺性阻碍了GNN的监督学习方法.
研究的目的:
- 引入一个可扩展的自我监督学习算法,用于在大型图表上训练GNN.
- 解决端到端培训在内存,计算和注释要求方面的局限性.
主要方法:
- 提出一个层wise规则化图形Infomax (LRGI),一个自我监督的学习算法.
- 在预测编码的启发下,LRGI逐层训练GNN,将复杂性与网络深度脱.
- 每个层都学会预测邻居传播的特征,从而实现独立的训练,并为多样化的表示体纳入规范化.
主要成果:
- LRGI在大型图表上展示了GNN的可扩展训练,显著提高了效率.
- 该方法在大型诱导图标基准上实现了与最先进的端到端方法相比具有竞争力的性能.
- 实际上,LRGI有效地缓解了深度GNN中的过度平滑问题.
结论:
- LRGI提供了一种高效且可扩展的解决方案,用于在大型图形数据上训练GNN.
- 这种分层,自我监督的方法克服了传统GNN培训方法的关键局限性.
- 这种算法有助于将深度GNN应用于复杂的大图问题.
相关概念视频
Survival Tree
166
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
166
Sequence Networks of Rotating Machines
150
A Y-connected synchronous generator, grounded through a neutral impedance, is designed to produce balanced internal phase voltages with only positive-sequence components. The generator's sequence networks include a source voltage that is exclusively in the positive-sequence network. The sequence components of line-to-ground voltages at the generator terminals illustrate this configuration.
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
Zero-sequence current induces a voltage drop across the generator's neutral impedance and other...
150
Observational Learning
321
Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning...
321
Neural Circuits
1.6K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
1.6K
Introduction to Learning
551
Learning is the process of acquiring knowledge or skills through practice or experience, leading to long-lasting behavioral changes. This acquisition occurs through interaction with the environment and requires practice or experience. For instance, mastering a skill such as surfing requires considerable practice and experience, highlighting the essential role of repeated interactions with the environment in learning.
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
In contrast to learned behaviors, unlearned behaviors such as crying, sexual...
551
Associative Learning
605
Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...
Classical conditioning, also known...
605

