神经多元体与相关变量的线性分类
Albert J Wakhloo1,2, Tamara J Sussman2,3, SueYeon Chung1,4
1Center for Computational Neuroscience, Flatiron Institute, 162 Fifth Avenue, New York, New York 10010, USA.
Physical review letters
|July 28, 2023
概括
神经活动的相关性通过改变对象表示的几何学来影响分类性能. 这项研究揭示了几何二元性,它将深度学习模型中的相关性与线性分离性联系起来.
科学领域:
- 理论神经科学理论神经科学
- 深度学习是一种深度学习.
- 计算神经科学是一种计算神经科学.
背景情况:
- 了解神经活动的统计和几何特性对于神经科学和深度学习的表现至关重要.
- 用容量衡量的线性分离性是评估分类性能的一个关键指标.
研究的目的:
- 研究对象表示之间的相关性如何影响神经网络的能力.
- 为了揭示相关性,几何和分类性能之间的关系.
主要方法:
- 计算相关性对球形物体多元体容量的影响.
- 分析中心体和轴之间的相关性如何改变几何性质.
主要成果:
- 中心体之间的相关性将对象表示方式拉近,减少容量.
- 轴之间的相关性有效地缩小了表示半径,也减少了容量.
- 在相关性和分类能力之间存在几何二元性.
结论:
- 这项研究为了解神经活动相关性如何影响线性分离性提供了一个框架.
- 结果可用于准确估计深度网络数据的容量.
- 结果提供了关于神经系统分类的几何基础的见解.
相关概念视频
Classification of Systems-II
178
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
178
Classification of Systems-I
215
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
215
Classification of Neurotransmitters
3.0K
Neurotransmitters play a crucial role in the communication between neurons in the autonomic nervous system. Neurons in the autonomic nervous system can be cholinergic or adrenergic depending on the neurotransmitters synthesized. Cholinergic neurons use acetylcholine as their primary neurotransmitter. This includes all the preganglionic fibers of the sympathetic and pre- and postganglionic fibers of the parasympathetic nervous systems. In addition, neurons of the somatic nervous system also use...
3.0K
Classification of Signals
533
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
533
Classification of Skeletal Muscle Fibers
56.6K
Skeletal muscles continuously produce ATP to provide the energy that enables muscle contractions. Skeletal muscle fibers can be categorized into three types based on differences in their contraction speed and how they produce ATP, as well as physical differences related to these factors. Most human muscles contain all three muscle fiber types, albeit in varying proportions.
Slow-Twitch Muscle Fibers
Slow oxidative, muscle fibers appear red due to large numbers of capillaries and high levels of...
Slow-Twitch Muscle Fibers
Slow oxidative, muscle fibers appear red due to large numbers of capillaries and high levels of...
56.6K
Functional Classification of Joints
4.2K
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
4.2K


