Modality-switching in the Simon task: The clash of reference frames.

Area of Science:

• Cognitive Psychology
• Neuroscience
• Human-Computer Interaction

Background:

• Stimulus-Response (S-R) compatibility effects, like the Simon task, demonstrate how irrelevant spatial information influences behavior.
• Real-world scenarios involve multiple sensory modalities (vision, touch, audition) processing spatial information in different coordinate systems.

Purpose of the Study:

• To investigate Stimulus-Response compatibility effects in mixed-modality contexts.
• To determine how spatial information from different sensory modalities interacts and influences behavior.

Main Methods:

• Participants performed Simon tasks involving single or mixed sensory modalities (vision, touch, audition).
• The study analyzed the presence and frame of reference of Simon effects across different modality combinations.

Main Results:

• Single-modality Simon effects showed vision using an external frame and touch using an anatomical frame.
• Mixing visual and tactile trials unpredictably eliminated the visual Simon effect, while tactile effects persisted anatomically.
• Mixing visual and auditory trials did not eliminate the visual Simon effect; both modalities showed external frame effects.

Conclusions:

• The brain dynamically reorganizes the weighting of spatial information sources based on sensory context.
• Tactile spatial information is processed independently in an anatomical frame, even when vision is present.
• The interaction between visual and tactile spatial information leads to the suppression of visual Simon effects, suggesting modality-specific processing and integration.