Jensen-Shannon Divergence と Minmax Divergence の間の厳格な境界は,次の2つの条件によって定義されている
Arseniy Akopyan1, Herbert Edelsbrunner2, Žiga Virk3,4
1Fora Capital, Miami, FL 33131, USA.
Entropy (Basel, Switzerland)
|August 28, 2025
まとめ
Jensen-Shannonの分散によって近似することができる. この発見は,情報幾何学の分析を簡素化します.
科学分野:
- 情報理論
- ジオメトリック解析
- 確率と統計
背景:
- 確率分布を比較することは様々な科学分野において極めて重要です.
- ジェンセン・シャノン分散 (JSD) は,分布の比較のために広く使用される計算可能なメトリックである.
- ミニマックスディバージェンスは,潜在的な幾何学的な解釈を持つ代替手段を提供しますが,計算的には困難です.
研究 の 目的:
- Jensen-Shannon分散と有限なカテゴリ分布の最小分散を比較する.
- この2つの非相似度間の理論的関連を確立する.
- ミニマックスディバージェンスのメトリック特性を調査する.
主な方法:
- クールバック-ライブラーの差異を 両方の測定の基礎として利用する.
- ジェンセン=シャノン分岐を用いて最小分岐を近似するための理論的境界を策定する.
- 最小分散の平方根のメトリック特性を分析する.
主要な成果:
- ミニマックス分散は,ジェンセン-シャノン分散によって緊密に近似することができます.
- 引導された境界は,最小最大分岐の平方根がメトリックであるという仮説を支持する.
- 一次元の場合の平方根がメトリックであることを証明しました.
結論:
- ジェンセン・シャノン分岐は,計算が密集した最小最大分岐の実用的で正確な近似を提供します.
- この研究は,情報幾何学の不相似度に関する理解を深める.
- 一般的なケースでは,最小最大分岐のメトリック特性を証明するためにさらなる研究が必要である.
関連する概念動画
Divergence and Stokes' Theorems
1.9K
The divergence and Stokes' theorems are a variation of Green's theorem in a higher dimension. They are also a generalization of the fundamental theorem of calculus. The divergence theorem and Stokes' theorem are in a way similar to each other; The divergence theorem relates to the dot product of a vector, while Stokes' theorem relates to the curl of a vector. Many applications in physics and engineering make use of the divergence and Stokes' theorems, enabling us to write...
1.9K
Mean Absolute Deviation
2.7K
The mean absolute deviation is also a measure of the variability of data in a sample. It is the absolute value of the average difference between the data values and the mean.
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
Let us consider a dataset containing the number of unsold cupcakes in five shops: 10, 15, 8, 7, and 10. Initially, calculate the sample mean. Then calculate the deviation, or the difference, between each data value and the mean. Next, the absolute values of these deviations are added and divided by the sample size to...
2.7K
Divergence and Curl
1.9K
The divergence of a vector field at a point is the net outward flow of the flux out of a small volume through a closed surface enclosing the volume, as the volume tends to zero. More practically, divergence measures how much a vector field spreads out or diverges from a given point. For an outgoing flux, conventionally, the divergence is positive. The diverging point is often called the "source" of the field. Meanwhile, the negative divergence of a vector field at a point means that the...
1.9K
Routh-Hurwitz Criterion II
400
In the application of the Routh-Hurwitz criterion, two specific scenarios can arise that complicate stability analysis.
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
The first scenario occurs when a singular zero appears in the first column of the Routh table. This situation creates a division by zero issues. To resolve this, a small positive or negative number, denoted as epsilon (∈), is substituted for the zero. The stability analysis proceeds by assuming a sign for ∈. If ∈ is positive, any sign change in the first...
400
Central Limit Theorem
15.9K
The central limit theorem, abbreviated as clt, is one of the most powerful and useful ideas in all of statistics. The central limit theorem for sample means says that if you repeatedly draw samples of a given size and calculate their means, and create a histogram of those means, then the resulting histogram will tend to have an approximate normal bell shape. In other words, as sample sizes increase, the distribution of means follows the normal distribution more closely.
The sample size, n, that...
The sample size, n, that...
15.9K
Range Rule of Thumb to Interpret Standard Deviation
9.3K
The range rule of thumb in statistics helps us calculate a dataset's minimum and maximum values with known standard deviation. This rule is based on the concept that 95% of all values in a dataset lie within two standard deviations from the mean.
For instance, the range rule of thumb can be used to find the tallest and the shortest student in a class, given the mean student height and standard deviation. If the mean student height is 1.6 m and the standard deviation, s is 0.05 m, the height...
For instance, the range rule of thumb can be used to find the tallest and the shortest student in a class, given the mean student height and standard deviation. If the mean student height is 1.6 m and the standard deviation, s is 0.05 m, the height...
9.3K


