Illuminating Salient Contributions in Neuron Activation With Attribution Equilibrium.
IEEE Transactions on Pattern Analysis and Machine Intelligence
|October 24, 2024
Summary
Attribution Equilibrium offers a new way to understand deep neural network decisions. This method balances positive and negative relevance for clearer visualizations of evidence, improving feature identification.
Area of Science:
- Artificial Intelligence
- Computer Vision
- Machine Learning
Background:
- Deep neural networks (DNNs) achieve high performance but lack transparency.
- Interpreting DNN decision-making is crucial for trust and debugging.
- Existing attribution methods offer limited insights into evidence conservation.
Purpose of the Study:
- Introduce Attribution Equilibrium, a novel method for decomposing DNN predictions.
- Provide fine-grained attributions by balancing positive and negative relevance.
- Enhance visualization of evidence supporting network decisions.
Main Methods:
- Define evidence as the gap between positive and negative influences in gradient-derived maps.
- Incorporate antagonistic elements and user-defined positive attribution criteria.
- Consider inactivated neurons in propagation to discern less relevant features like background.
Main Results:
- Attribution Equilibrium decomposes predictions into fine-grained attributions.
- The method balances positive and negative relevance for clearer evidence visualization.
- Evaluations on PASCAL VOC 2007, MS COCO 2014, and ImageNet datasets show superior performance.
Conclusions:
- Attribution Equilibrium outperforms existing methods in identifying key input features.
- The novel approach enhances the discernment of relevant and irrelevant input features.
- This method offers a clearer perspective on the conservation of evidence in DNNs.
More Related Videos
Related Concept Videos
Fundamental Attribution Error
12.8K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
12.8K
Attribution Theory
12.9K
Behavior is a product of both the situation (e.g., cultural influences, social roles, and the presence of bystanders) and of the person (e.g., personality characteristics). Subfields of psychology tend to focus on one influence or behavior over others. Situationism is the view that our behavior and actions are determined by our immediate environment and surroundings. In contrast, dispositionism holds that our behavior is determined by internal factors (Heider, 1958).
12.9K
Cognitive Theories: Schachter-Singer Theory of Emotion
294
Stanley Schachter and Jerome Singer proposed the two-factor theory of emotion, which emphasizes the interplay between physiological arousal and cognitive labeling in forming emotional experiences. This theory suggests that emotions are not simply a result of physiological responses but rather a combination of these responses and the individual's cognitive interpretation of them.
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
Physiological Arousal and Cognitive Labeling
According to this theory, when an individual experiences...
294
The Role of Ion Channels in Neuronal Computation
3.1K
A postsynaptic neuron usually receives numerous impulses from several other presynaptic neurons. The axon hillock of the postsynaptic neuron integrates all these signals and determines the likelihood of firing an action potential.
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
Sometimes a single EPSP is strong enough to induce an action potential in the postsynaptic neuron. However, multiple presynaptic inputs must often create EPSPs around the same time for the postsynaptic neuron to be sufficiently depolarized to fire an action potential....
3.1K
Reason and Intuition
6.4K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
6.4K
Action Potential
7.8K
Neurons communicate by firing action potentials—the electrochemical signal that is propagated along the axon. The signal results in the release of neurotransmitters at axon terminals, thereby transmitting information to the nervous system. An action potential is a specific "all-or-none" change in membrane potential that results in a rapid spike in voltage.
Membrane potential in neurons
Neurons typically have a resting membrane potential of about -70 millivolts (mV). When they...
Membrane potential in neurons
Neurons typically have a resting membrane potential of about -70 millivolts (mV). When they...
7.8K


