Effect of Target Semantic Consistency in Different Sequence Positions and Processing Modes on T2 Recognition:...

Area of Science:

• Cognitive Psychology
• Auditory Perception
• Visual Attention

Background:

• The rapid serial visual presentation (RSVP) paradigm is used to study visual attention.
• Sound generally improves cross-modal processing, but the role of semantic information without saliency is underexplored.
• Attentional blink (AB) is a deficit in visual perception occurring after successful processing of a target.

Purpose of the Study:

• To investigate how sound semantic information, independent of saliency, affects attention and target recognition in RSVP.
• To examine the influence of semantic consistency between sounds and visual targets across different locations and processing modalities.
• To differentiate the effects of top-down versus bottom-up attention on sound-guided visual processing.

Main Methods:

• Utilized the rapid serial visual presentation (RSVP) paradigm.
• Manipulated semantic consistency between sounds and visual targets (Target 2).
• Investigated effects across different sound sequence locations and processing modalities (exogenous vs. endogenous attention).

Main Results:

• Cross-modal processing of sound significantly reduced the attentional blink (AB).
• Sound semantic consistency improved visual target judgments, particularly under endogenous attention.
• The sequential location of semantically consistent sounds influenced both auditory and visual congruency judgments.

Conclusions:

• Sound semantic information plays a crucial role in modulating visual attention and mitigating the attentional blink.
• Endogenous attention is key for leveraging semantic sound cues to enhance visual target processing.
• The findings highlight the complex interplay between auditory semantics, spatial location, and attentional control in cross-modal perception.