一个绑定权重的自动编码器用于样本数据的线性维度缩小.
Sunhee Kim1, Sang-Ho Chu2, Yong-Jin Park2
1The Department of Industrial Engineering, Kongju National University, Cheonan, 31080, Republic of Korea.
Scientific reports
|November 5, 2024
概括
这项研究引入了一个绑定权重的自动编码器来减少维度,平衡线性可解释性与非线性有效性. 该模型在重建和分类任务中优于线性方法.
科学领域:
- 机器学习 机器学习
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 缩小尺寸对于简化复杂数据集至关重要.
- 线性方法提供可解释性,但有效性有限.
- 非线性方法更有效,但可能缺乏可解释性.
研究的目的:
- 提出一种结合线性和非线性方法优势的新型维度缩小模型.
- 为了近似一个非线性绑定重量自动编码器作为一个线性模型.
- 为了提高可解释性,在减少维度的同时保持有效性.
主要方法:
- 使用了一个绑定权重的自动编码器架构.
- 通过删除非活化隐藏层单元,该模型被近似为线性.
- 性能与基准线性和非线性模型进行了评估.
主要成果:
- 拟议的模型表现出与类似的非线性自动编码器可比的性能.
- 该模型在关键指标上显著优于传统的线性模型.
- 通过平均平方误差,数据重建和分类任务来验证有效性.
结论:
- 绑定重量自动编码器为减小维度提供了一种混合方法.
- 该方法提供了可解释性和性能之间的平衡.
- 这项研究为减小维度技术提供了最佳实践建议.
相关概念视频
Linear Approximation in Frequency Domain
85
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
85
Linear Approximation in Time Domain
64
Nonlinear systems often require sophisticated approaches for accurate modeling and analysis, with state-space representation being particularly effective. This method is especially useful for systems where variables and parameters vary with time or operating conditions, such as in a simple pendulum or a translational mechanical system with nonlinear springs.
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
For a simple pendulum with a mass evenly distributed along its length and the center of mass located at half the pendulum's length,...
64
Weighted Mean
4.9K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
4.9K
Reducing Line Loss
144
In a three-phase circuit, line loss is an indicator of energy dissipated as heat due to the resistance of transmission lines. To address this, incorporating transformers into the system—a step-up transformer at the source and a step-down transformer at the load—is a strategic solution. Two three-phase transformers are introduced to improve this.
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
With a step-up transformer at the source, the voltage is increased, thereby reducing the current in the transmission lines since power loss...
144
Dimensional Analysis
848
Dimensional analysis is a powerful tool that is used in physics and engineering to understand and predict the behavior of physical systems. The basic idea behind dimensional analysis is to express physical quantities in terms of fundamental dimensions such as the mass, length, and time. Derived dimensions like the velocity, acceleration, and force are derived from the combinations of these fundamental dimensions.
Dimensional analysis allows us to analyze and compare physical quantities on a...
Dimensional analysis allows us to analyze and compare physical quantities on a...
848
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K


