数据效率,维度减小,以及通用对称信息瓶

K Michael Martini1, Ilya Nemenman2

  • 1Department of Physics and Initiative in Theory and Modeling of Living Systems, Emory University, Atlanta, GA 30322, U.S.A. karl.michael.martini@emory.edu.

Neural computation
|April 26, 2024
PubMed
概括

一般化的对称信息瓶 (GSIB) 提供了比独立方法更高效的数据同时压缩. 这种技术减少了压缩随机变量的数据集大小要求,同时保留了信息.

相关概念视频

Downsampling01:20

Downsampling

When considering a sampled sequence with zero values between sampling instants, one can replace it by taking every N-th value of the sequence. At these integer multiples of N, the original and sampled sequences coincide. This process, known as decimation, involves extracting every N-th sample from a sequence, thereby creating a more efficient sequence.
The Fourier transform of the decimated sequence reveals a combination of scaled and shifted versions of the original spectrum. This...
154
Dimensional Analysis01:27

Dimensional Analysis

Dimensional analysis is a valuable technique in fluid mechanics for simplifying complex problems by reducing them into dimensionless groups. These groups capture the essential relationships between the variables involved, allowing researchers and engineers to analyze fluid flow without dealing with each variable individually. This approach reduces the number of independent variables, allowing for easier analysis and better understanding of physical phenomena.
In fluid mechanics, dimensional...
319
Data: Types and Distribution01:19

Data: Types and Distribution

In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
718
Correlation of Experimental Data01:23

Correlation of Experimental Data

Dimensional analysis simplifies complex physical problems and guides experimental investigations, but it does not provide complete solutions. It identifies the dimensionless groups that influence a phenomenon, but experimental data is needed to establish the specific relationships and validate theoretical predictions.
For example, a spherical particle moving through a viscous fluid experiences drag. Dimensional analysis shows that the drag force depends on the particle's diameter, velocity,...
230
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
52
Trimmed Mean01:10

Trimmed Mean

While measuring the mean of a data set, care needs to be taken when associating the mean to its central tendency. The same goes for the arithmetic mean, the geometric mean, or the harmonic mean. This is because the presence of a single outlier data value can significantly affect the mean. That is, the mean is sensitive to fluctuations in the data set.
Although certain measures of central tendency are not sensitive to outliers, there are alternative versions of the mean that get around the...
2.9K