Related Experiment Video
Updated: Jun 18, 2025

06:30
Spotlighting Customers' Visual Attention at the Stock, Shelf and Store Levels with the 3S Model
Published on: May 24, 2019
5.2K
The label-feedback effect is influenced by target category in visual search.
Paolo Frugarello1,2, Elena Rusconi1,2, Remo Job1
1Department of Psychology and Cognitive Science, University of Trento, Rovereto (Trento), Italy.
Plos One
|August 1, 2024
Summary
Multimodal audio-visual labels enhance visual search performance, supporting the label-feedback hypothesis. This effect is stronger for structured categories like garments and proper weapons, not ad hoc ones.
Area of Science:
- Cognitive Psychology
- Neuroscience
- Human-Computer Interaction
Background:
- The label-feedback hypothesis suggests language influences visual processing.
- Auditory or visual target names (labels) can speed up visual search.
- Previous studies primarily used basic-level target names.
Purpose of the Study:
- To investigate the effect of multimodal audio-visual (AV) labels on visual search.
- To compare AV labels with unimodal (audio, visual) and multimodal noise-visual (NV) controls.
- To examine if the label-feedback effect extends to superordinate category labels and is modulated by category structure.
Main Methods:
- Participants performed a visual search task using superordinate category labels as cues.
- Label conditions included audio+visual (AV), noise+visual (NV), audio (A), and visual (V).
- Target items belonged to categories: garments, improper weapons (ad hoc), and proper weapons.
Main Results:
- Overall facilitation in visual search performance was observed in the AV condition compared to the NV condition.
- This facilitation was driven by the garments and proper weapons categories, not improper weapons.
- The label-feedback effect was confirmed for superordinate labels and modulated by category structure.
Conclusions:
- The label-feedback effect is not solely due to multimodal stimulation and extends to superordinate labels.
- The beneficial effect of AV labels requires "up-regulation" of the label, which is hindered for ad hoc categories.
- Category structure, specifically the ad hoc nature of improper weapons, influences the label-feedback effect.

