隐藏的马尔科夫神经网络
Lorenzo Rimella1,2, Nick Whiteley3
1Dipartimento di Scienze Economico-Sociali e Matematico-Statistiche, University of Torino, 10124 Torino, Italy.
Entropy (Basel, Switzerland)
|February 26, 2025
概括
我们介绍了隐藏的马尔科夫神经网络,这是一个新的贝叶斯方法,用于时间序列预测和持续学习. 这种方法平衡了适应新数据和忘记旧信息,以实现可靠的性能和不确定性量化.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 深度学习 (Deep Learning) 是一种深度学习.
背景情况:
- 时间序列预测和持续学习在平衡适应新数据和忘记过时信息方面面临挑战.
- 现有的模型很难有效地管理随着时间的推移而不断变化的数据分布.
研究的目的:
- 介绍一个新的贝叶斯神经网络架构,隐藏的马尔科夫神经网络 (HMNN).
- 解决对能够适应新信息的模型的关键需求,同时在动态环境中保留相关的过去知识.
主要方法:
- 模拟神经网络重量作为隐藏的状态在一个隐藏的马尔科夫模型 (HMM).
- 采用过算法来变化近似演变的后部分布在重量上的变化.
- 使用顺序的Bayes by Backprop方法与变化的DropConnect相结合,用于规范化和可扩展的推理.
主要成果:
- 在各种任务中,HMNN表现出强大的预测性能,包括图像识别 (MNIST),动态分类和视频预测.
- 该模型有效量化其预测中的不确定性.
- 通过先进的贝叶斯式技术实现了强大的规范化和可扩展的推理.
结论:
- 隐藏的马尔科夫神经网络为时间序列预测和持续学习提供了强大的解决方案.
- 拟议的方法为适应性学习提供了一个强大的框架,用于不确定性量化.
- 在动态数据场景的贝叶斯深度学习中,HMNN代表了重要的进步.
相关概念视频
01:37Neural Regulation
34.8K
Digestion begins with a cephalic phase that prepares the digestive system to receive food. When our brain processes visual or olfactory information about food, it triggers impulses in the cranial nerves innervating the salivary glands and stomach to prepare for food.
34.8K
01:19Masking and Demasking Agents
4.1K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
4.1K
01:25Neural Circuits
3.0K
Neural circuits and neuronal pools are two of the main structures found in the nervous system. Neural circuits are networks of neurons that work together to carry out a specific task or process. They consist of interconnected neurons and glial cells, which provide structural and metabolic support.
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
Neuronal pools are collections of nerve cells with similar functions and interact through chemical and electrical signals. These pools include both interneurons (the central neural circuit nodes that...
3.0K