Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

High-Level and Low-Level Awareness01:19

High-Level and Low-Level Awareness

258
Controlled processes in human consciousness represent high-alert mental states where individuals deliberately focus their attention on achieving specific goals. Controlled processes can be seen in situations like mastering new technology, where a person might become so absorbed that they ignore surrounding distractions. Such processes involve selective attention, requiring one to concentrate on particular elements of experience while disregarding others. These are governed by executive...
258
Subconsciousness and No Awareness01:15

Subconsciousness and No Awareness

233
The concept of subconscious awareness refers to the processing of information below the level of conscious thought, which significantly influences both behaviors and decisions. It is also known as waking subconscious awareness. This complex level of cognition operates without the direct awareness of the individual, facilitating rapid and simultaneous handling of multiple information streams.
An illustrative example of subconscious processing is its role in problem-solving. Often, individuals...
233
Subliminal Perception01:15

Subliminal Perception

247
Subliminal perception refers to the processing of sensory information that occurs below the level of conscious awareness. Researchers study subliminal perception by presenting a stimulus, such as a word or image, very quickly, typically around 50 milliseconds. This rapid presentation is often followed by another stimulus, such as a pattern of dots or lines, which blocks further mental processing of the initial stimulus. As a result, if participants cannot identify the initial stimulus better...
247

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Comparative risk of epilepsy with SGLT2 inhibitors versus incretin-based therapies in type 2 diabetes.

Epilepsia·2026
Same author

Genetic Risk Factors for Intracerebral Hemorrhage in Populations of East Asian Ancestry.

Neurology. Genetics·2026
Same author

Fitness inference tested by in silico population genetics.

Physical review. E·2026
Same author

Genetic Determinants of Spontaneous Hepatitis B Surface Antigen Seroclearance and Its Associated Viral Markers.

Alimentary pharmacology & therapeutics·2026
Same author

Effects of hypoxia-inducible factor prolyl hydroxylase inhibitors on lipid profiles in patients with chronic kidney disease: a systematic review and meta-analysis.

European journal of clinical pharmacology·2026
Same author

Contrastive Mixture Diffusion Models.

IEEE transactions on pattern analysis and machine intelligence·2026

Related Experiment Video

Updated: Jun 19, 2025

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control
09:37

Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

Published on: July 5, 2015

9.0K

Latent Semantic and Disentangled Attention.

Jen-Tzung Chien, Yu-Han Huang

    IEEE Transactions on Pattern Analysis and Machine Intelligence
    |July 23, 2024
    PubMed
    Summary

    This study introduces Bayesian clustered disentanglement for mask attention in transformers. It addresses redundancy and model capacity issues in attention mechanisms, improving sequence data representation.

    Area of Science:

    • Artificial Intelligence
    • Natural Language Processing
    • Machine Learning

    Background:

    • Transformer models excel in sequential tasks due to multi-head self-attention.
    • Current attention mechanisms suffer from information redundancy, limited model capacity, and lack of robustness.

    Purpose of the Study:

    • To propose a novel Bayesian semantic and disentangled mask attention mechanism.
    • To address weaknesses in existing transformer attention frameworks, specifically redundancy and model uncertainty.

    Main Methods:

    • Developed a Bayesian learning approach for clustered disentanglement.
    • Implemented a mask optimized via semantic clustering to filter attention weights.
    • Introduced latent topic information to compensate for redundant features.

    More Related Videos

    Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
    13:00

    Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

    Published on: January 23, 2017

    9.9K
    A Dual Task Procedure Combined with Rapid Serial Visual Presentation to Test Attentional Blink for Nontargets
    08:45

    A Dual Task Procedure Combined with Rapid Serial Visual Presentation to Test Attentional Blink for Nontargets

    Published on: December 5, 2014

    9.2K

    Related Experiment Videos

    Last Updated: Jun 19, 2025

    Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control
    09:37

    Measurement of Neurophysiological Signals of Ignoring and Attending Processes in Attention Control

    Published on: July 5, 2015

    9.0K
    Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments
    13:00

    Measuring Attention and Visual Processing Speed by Model-based Analysis of Temporal-order Judgments

    Published on: January 23, 2017

    9.9K
    A Dual Task Procedure Combined with Rapid Serial Visual Presentation to Test Attentional Blink for Nontargets
    08:45

    A Dual Task Procedure Combined with Rapid Serial Visual Presentation to Test Attentional Blink for Nontargets

    Published on: December 5, 2014

    9.2K

    Main Results:

    • The proposed Bayesian clustered disentanglement effectively reduces redundant features in sequence data representation.
    • The method enhances model capacity by addressing similar attention weight patterns across heads.
    • Experiments demonstrate improved performance in machine translation and speech recognition tasks.

    Conclusions:

    • Bayesian clustered disentanglement for mask attention offers a robust solution to transformer weaknesses.
    • The approach enhances semantic understanding and data representation in sequential learning.
    • This method shows significant merit for applications like machine translation and speech recognition.