不確実性定量化を伴う転移学習:ソースからターゲットへのランダム効果キャリブレーション(RECaST)
Jimmy Hickey1, Jonathan P Williams2, Emily C Hector1
1Department of Statistics, North Carolina State University.
まとめ
RECaSTを紹介します。これは、新しい集団のためにモデルを再調整する転移学習のための新しい統計的フレームワークです。このアプローチは、多くの既存の方法とは異なり、重要な不確実性定量化を提供します。
科学分野:
- 統計学
- 機械学習
- データサイエンス
背景:
- 転移学習は、あるデータセットでトレーニングされたモデルを別のデータセットで使用するために適応させます。
- 現在の転移学習方法には、しばしば不確実性定量化が欠けています。
- 事前トレーニングされたニューラルネットワークのファインチューニングは、一般的ですが限定的なアプローチです。
研究 の 目的:
- 不確実性定量化を伴う転移学習のための統計的フレームワークを開発すること。
- RECaST(統計的転移のためのコーシーランダム効果による再調整)フレームワークを導入すること。
- さまざまなモデルタイプにわたるRECaSTの妥当性と堅牢性を実証すること。
主な方法:
- モデルの再調整のためのコーシーランダム効果を利用する統計的フレームワークRECaSTを開発しました。
- 線形モデルに対してRECaSTを数学的および経験的に検証し、予測セットカバレッジを保証しました。
- 非線形モデルのロバスト性を数値的に示し、漸近近似に対する耐性を示しました。
主要な成果:
- RECaSTは、転移学習予測のための不確実性定量化を提供します。
- このフレームワークはソースモデルに依存せず、ソースデータへのアクセスを必要としません。
- シミュレーションと実世界の病院データ分析を通じてRECaSTの有効性を実証しました。
結論:
- RECaSTは、転移学習のための統計的に健全で用途の広いアプローチを提供します。
- 不確実性定量化の包含は、既存の方法における重要なギャップに対処します。
- RECaSTは、さまざまな集団やデータタイプにわたる信頼性の高いモデル適応に有望です。
関連する概念動画
Uncertainty in Measurement: Accuracy and Precision
99.3K
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
99.3K
Propagation of Uncertainty from Random Error
1.6K
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
1.6K
Propagation of Uncertainty from Systematic Error
1.2K
The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...
1.2K
Calibration Curves: Linear Least Squares
4.0K
A calibration curve is a plot of the instrument's response against a series of known concentrations of a substance. This curve is used to set the instrument response levels, using the substance and its concentrations as standards. Alternatively, or additionally, an equation is fitted to the calibration curve plot and subsequently used to calculate the unknown concentrations of other samples reliably.
For data that follow a straight line, the standard method for fitting is the linear...
For data that follow a straight line, the standard method for fitting is the linear...
4.0K
Uncertainty: Overview
1.5K
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
1.5K
Instrument Calibration
652
Instrument calibration is essential for ensuring that instruments produce accurate and consistent results. It is vital in manufacturing, healthcare, testing laboratories, and scientific research. Calibration processes are specific to each instrument and help enhance data accuracy. Each instrument has a unique calibration process tailored to its design and function to improve data accuracy.
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
Analytical Balance Calibration
An analytical balance measures mass and requires regular calibration to...
652


