由指数数组的累积和分割函数引起的分歧及其由比较凸度引起的变形
1Sony Computer Science Laboratories, Tokyo 141-0022, Japan.
Entropy (Basel, Switzerland)
|March 28, 2024
概括
指数式家族是关键的统计模型,它们的α-分歧通过分区函数与詹森分歧联系在一起. 相对凸性进一步定义了双平面空间和分歧.
科学领域:
- 统计 统计 统计 统计
- 信息理论 信息理论
- 机器学习 机器学习
背景情况:
- 指数式家族是各种学科中使用的基本统计模型.
- 这些模型的特点是累积/自由能量或分区函数,这些函数诱导了布雷格曼和詹森的分歧.
- 现有的研究将Bhattacharyya和Kullback-Leibler分歧与指数家族中的Jensen和Bregman分歧联系起来.
研究的目的:
- 为了研究α-分歧和指数家族内的分歧之间的关系.
- 探索比较凸性如何定义双平面空间和相关的分歧.
主要方法:
- 分析指数家族的非规范密度之间的α-分歧.
- 使用比较凸度与准算术手段来扭曲函数及其参数.
主要成果:
- 证明了指数家族的α-分歧与分区函数诱导的缩放的α-倾斜的詹森分歧相对应.
- 展示了比较凸性如何导致二元平面空间及其分歧的定义.
结论:
- 在指数家族中建立了α-分歧和詹森分歧之间的新连接.
- 引入了一种使用比较凸性的方法来构建双重平面空间和相关的分歧,保持普通的凸性.
相关概念视频
Divergence and Stokes' Theorems
1.6K
The divergence and Stokes' theorems are a variation of Green's theorem in a higher dimension. They are also a generalization of the fundamental theorem of calculus. The divergence theorem and Stokes' theorem are in a way similar to each other; The divergence theorem relates to the dot product of a vector, while Stokes' theorem relates to the curl of a vector. Many applications in physics and engineering make use of the divergence and Stokes' theorems, enabling us to write...
1.6K
Divergence and Curl
1.7K
The divergence of a vector field at a point is the net outward flow of the flux out of a small volume through a closed surface enclosing the volume, as the volume tends to zero. More practically, divergence measures how much a vector field spreads out or diverges from a given point. For an outgoing flux, conventionally, the divergence is positive. The diverging point is often called the "source" of the field. Meanwhile, the negative divergence of a vector field at a point means that the...
1.7K
Divergence and Curl of Electric Field
5.6K
The divergence of a vector is a measure of how much the vector spreads out (diverges) from a point. For example, an electric field vector diverges from the positive charge and converges at the negative charge. The divergence of an electric field is derived using Gauss's law and is equal to the charge density divided by the permittivity of space. Mathematically, it is expressed as
5.6K
Castigliano's Theorem
396
Castigliano's theorem analyzes displacements and rotations in elastic structures. It relates the derivative of elastic strain energy to the applied forces or moments, allowing for the calculation of deformations. The theorem states that the partial derivative of the total strain energy of a system with respect to a specific load results in the displacement at the point where the load is applied. This principle applies to both forces and moments.
396
Second Derivatives and Laplace Operator
1.2K
The first order operators using the del operator include the gradient, divergence and curl. Certain combinations of first order operators on a scalar or vector function yield second order expressions. Second-order expressions play a very important role in mathematics and physics. Some second order expressions include the divergence and curl of a gradient function, the divergence and curl of a curl function, and the gradient of a divergence function.
Consider a scalar function. The curl of its...
Consider a scalar function. The curl of its...
1.2K
Region of Convergence of Laplace Tarnsform
540
The Region of Convergence (ROC) is a fundamental concept in signal processing and system analysis, particularly associated with the Laplace transform. The ROC represents an area in the complex plane where the Laplace transform of a given signal converges, determining the transform's applicability and utility.
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
Consider a decaying exponential signal that begins at a specific time. When deriving its Laplace transform, the time-domain variable is replaced with a complex variable. This...
540


