什么是冗余?什么是冗余?
Clifford Bohm1, Christoph Adami2,3, Arend Hintze4
1Department of Computer Science and Engineering, Michigan State University, East Lansing, MI 48824, USA.
Entropy (Basel, Switzerland)
|February 27, 2026
概括
本研究通过区分操作冗余 (基于任务的预测) 和信息冗余 (内容重叠) 来澄清信息理论中冗余的模糊概念. 将这些概念分开解决了悖论,并指导了未来的研究.
科学领域:
- 多变量信息理论 多变量信息理论
- 计算神经科学是一种神经科学.
- 机器学习 机器学习
背景情况:
- 在多变量信息理论中,冗余的概念是含糊不清的定义,导致混乱.
- 现有的文献将操作和信息冗余混为一谈,导致悖论,特别是独立输入.
研究的目的:
- 为了正式区分操作和信息冗余.
- 解决信息理论中的概念模两可和明显悖论.
- 为未来关于冗余性的研究提供一个明确的框架.
主要方法:
- 正式化两种不同的冗余类别:操作和信息.
- 分析功能示例和有偏见的输入集.
- 使用信息理论原则展示区别.
主要成果:
- 运营冗余与预测的输入充足性/可替代性有关.
- 信息冗余性涉及输入之间的共享内容,通过相互信息来衡量.
- 证明了缺乏信息重叠的输入可以表现出运营冗余.
结论:
- 建议明确分离操作和信息冗余.
- 这种区分说明了为什么裁员是难以捉摸的,为什么单一的措施是不够的.
- 概述了未来理论和应用工作的最低承诺.
相关概念视频
Ending Relationships
226
The dissolution of intimate relationships presents complex emotional and psychological challenges, particularly when emotional bonds are strong, the relationship is long-standing, and perceived alternatives are limited. This distress often intensifies in romantic breakups, where the initiator may experience greater turmoil than the rejected partner. Contributing factors include residual attachment, guilt over causing pain, and uncertainty about how to manage the situation. The stress is further...
226
Retrieval
485
Retrieval is the process of getting information out of memory storage and back into conscious awareness. This ability is essential for daily tasks like brushing hair and teeth, driving to work, and performing job duties. Retrieval occurs in three ways: recall, recognition, and relearning.
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
Recall involves accessing information without cues, such as during an essay test, where individuals must retrieve facts and concepts from memory unaided. Another example is remembering the name of a colleague...
485
Variation
8.2K
An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
8.2K
Relative Risk
2.3K
Relative risk (RR) is a statistical measure commonly used in epidemiology to compare the likelihood of a particular event occurring between two groups. This metric is important for evaluating the relationship between exposure to a specific risk factor and the probability of a particular outcome. It plays a crucial role in medical research, public health studies, and risk assessment. Relative risk quantifies how much more (or less) likely an event is to occur in an exposed group compared to an...
2.3K
Truncation in Survival Analysis
663
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
663
Redox Equilibria: Overview
1.7K
A reduction-oxidation reaction is commonly called a redox reaction. In a redox reaction, electrons are transferred from one species to another rather than being shared between or among atoms. The reducing agent or reductant is the species that loses electrons and gets oxidized in the process. The species that gains electrons and gets reduced in the process is the oxidizing agent or oxidant. Redox reactions are represented as two separate equations called half-reactions, where one equation...
1.7K


