渐变信息的神经网络:在低数据场景中嵌入先前的学习信念
Filippo Aglietti1, Francesco Della Santa2, Andrea Piano3
1Energy Department, Politecnico di Torino, Corso Duca degli Abruzzi 24, Turin, 10129, Turin, Italy; Dumarey Automotive Italia S.p.A., Corso Castelfidardo 36, Turin, 10129, Italy.
概括
梯度信息神经网络 (gradNNs) 通过使用先前对衍生品的信念,有效地通过有限的数据对函数进行近似计算. 这种方法在复杂的工程任务中表现出强的性能,特别是在低数据场景中.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 数字分析 数字分析
背景情况:
- 复杂的工程问题往往涉及低数据的制度,其中标准函数近似方法扎.
- 关于函数行为的一般预先信念经常可用,但很难直接纳入模型.
研究的目的:
- 在低数据场景中引入梯度信息神经网络 (gradNNs) 进行高效的函数近似.
- 为了利用关于函数导数的先前信念来指导神经网络训练而没有明确的导数数据.
主要方法:
- 利用两个神经网络:一个用于函数近似和一个辅助网络用于编码先前的衍生信念.
- 开发了一个定制的损失函数,以执行来自辅助网络的梯度约束,允许数据驱动的放松.
- 将该方法应用于合成基准函数和现实世界的工程任务.
主要成果:
- 与标准神经网络相比,gradNNs表现出更高的性能,特别是在低数据模式下.
- 该方法有效地纳入了关于第一阶衍生函数的先前知识,以塑造函数近似.
- 在各种场景中取得了强的结果,验证了该方法的实际应用.
结论:
- 在数据稀缺的情况下,渐变信息神经网络为函数近似提供了高效和有效的解决方案.
- 该框架成功地整合了关于衍生品的一般预先信念,在具有挑战性的工程环境中增强了模型性能.
- 在数据有限的科学和工程领域, gradNNs代表了机器学习的有希望的进步.
相关概念视频
What is an Electrochemical Gradient?
128.5K
Adenosine triphosphate, or ATP, is considered the primary energy source in cells. However, energy can also be stored in the electrochemical gradient of an ion across the plasma membrane, which is determined by two factors: its chemical and electrical gradients.
The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an...
The chemical gradient relies on differences in the abundance of a substance on the outside versus the inside of a cell and flows from areas of high to low ion concentration. In contrast, the electrical gradient revolves around an...
128.5K
Pharmaceutical Poisoning: Potential Scenarios
1
Pharmaceutical poisoning can occur through various channels, impacting an estimated 2 million hospitalized patients in the U.S. annually with serious adverse drug responses. These scenarios encompass both therapeutic uses, such as drug toxicity, where even standard dosages can lead to severe central nervous system depression, and non-therapeutic exposures, including accidental ingestion by children, and environmental and occupational exposures.Unintentional poisonings often involve exploratory...
1
Protein Networks
4.6K
An organism can have thousands of different proteins, and these proteins must cooperate to ensure the health of an organism. Proteins bind to other proteins and form complexes to carry out their functions. Many proteins interact with multiple other proteins creating a complex network of protein interactions.
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
These interactions can be represented through maps depicting protein-protein interaction networks, represented as nodes and edges. Nodes are circles that are representative of a protein,...
4.6K
Network Covalent Solids
16.2K
Network covalent solids contain a three-dimensional network of covalently bonded atoms as found in the crystal structures of nonmetals like diamond, graphite, silicon, and some covalent compounds, such as silicon dioxide (sand) and silicon carbide (carborundum, the abrasive on sandpaper). Many minerals have networks of covalent bonds.
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
To break or to melt a covalent network solid, covalent bonds must be broken. Because covalent bonds are relatively strong, covalent network solids are typically...
16.2K
Avoidance Learning and Learned Helplessness
2.6K
Avoidance learning and learned helplessness are critical concepts in understanding behavioral responses to negative stimuli.
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
Avoidance learning occurs when an organism learns that a specific behavior can prevent an unpleasant outcome. For example, a student who receives a bad grade may start studying harder to avoid future poor grades. This behavior persists even when the negative outcome is no longer present. Avoidance learning is powerful because it maintains behavior in the absence of the...
2.6K
Energy Line and Hydraulic Gradient Line
2.4K
Based on Bernoulli's equation, the energy line (EL) and hydraulic grade line (HGL) provide graphical representations of energy distribution in a fluid flow system. For steady, incompressible, inviscid flows, Bernoulli's equation is expressed as:
2.4K


