関連する実験動画
Updated: Sep 9, 2025

13:19
Deep Neural Networks for Image-Based Dietary Assessment
Published on: March 13, 2021
9.3K
温和分数グラデント下降:理論,アルゴリズム,および堅固な学習アプリケーション
1National School of Engineering, Control and Energy Management Laboratory, University of Sfax, BP 1173, Sfax, 3038, Tunisia; Higher Institute of Applied Sciences and Technology of Kairouan, University of Kairouan, Kairouan, Tunisia.
まとめ
テンプレッド・フラクショナル・グラデント・デッサント (TFGD) は,分数式微積分と指数式テンプレートを用いて機械学習を強化します. この新しい最適化フレームワークは,従来の方法と比較して複雑なデータセットの収束速度と精度を向上させます.
科学分野:
- 機械学習
- 最適化アルゴリズム
- 分数式微積分
背景:
- 伝統的なグラデント降下方法は,高次元で騒々しいデータ景観でゆっくりと収束し,振動します.
- 既存の最適化器は,より堅固なアプローチを必要とする複雑な最適化問題と闘っています.
研究 の 目的:
- 新しい最適化フレームワークであるテンパード・フラクション・グラデント・デッサント (TFGD) を導入する.
- 分数式微積分と指数式テンプレートを統合することで グラデーションベースの学習を強化します
- 伝統的な方法の収束と安定性の限界に対処する.
主な方法:
- 微分係数と指数分解のテンプレートメモリメカニズムを組み込むことでTFGDを開発しました.
- コンベックスとストキャスティック設定の理論的収束保証を分析した.
- TFGDの業績を様々なベンチマークデータセットで実証した.
主要な成果:
- TFGDは,SGDとAdamと比較して,乳がんウィスコンシン (98. 25%) とMNIST (99. 1%) で優れた精度を達成しました.
- 医学的な分類ではSGDよりも2倍速く収束し,非凸の設定ではよりスムーズに最適化することが示されました.
- 騒音データに対する最適なハイパーパラメータ範囲 (α=0.6-0.7, λ=0.3-0.5) を特定した.
結論:
- TFGDは従来の最適化器の強力な代替手段であり,収束と安定性を改善します.
- テンプレートメモリメカニズムは,相関する特徴を持つデータセットに有効です.
- TFGDは理論的および応用的な機械学習のタスクの両方に大きな希望を示しています.
関連する概念動画
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
100
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
100
Gradient and Del Operator
2.9K
In mathematics and physics, the gradient and del operator are fundamental concepts used to describe the behavior of functions and fields in space. The gradient is a mathematical operator that gives both the magnitude and direction of the maximum spatial rate of change. Consider a person standing on a mountain. The slope of the mountain at any given point is not defined unless it is quantified in a particular direction. For this reason, a "directional derivative" is defined, which is a vector...
2.9K
Regression Toward the Mean
6.5K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.5K
Genetic Drift
40.6K
Natural selection—probably the most well-known evolutionary mechanism—increases the prevalence of traits that enhance survival and reproduction. However, evolution does not merely propagate favorable traits, nor does it always benefit populations.
40.6K
Time-Domain Interpretation of PD Control
178
Proportional-Derivative (PD) control is a widely used control method in various engineering systems to enhance stability and performance. In a system with only proportional control, common issues include high maximum overshoot and oscillation, observed in both the error signal and its rate of change. This behavior can be divided into three distinct phases: initial overshoot, subsequent undershoot, and gradual stabilization.
Consider the example of control of motor torque. Initially, a positive...
Consider the example of control of motor torque. Initially, a positive...
178
PD Controller: Design
349
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
349
