Multimodal Simon Effect: A Multimodal Extension of the Diffusion Model for Conflict Tasks

Area of Science:

• Cognitive Psychology
• Neuroscience
• Human-Computer Interaction

Background:

• Conflict tasks, such as the Simon task, examine how irrelevant information impacts relevant information processing.
• The current study extends the Simon task to a multimodal context, incorporating stimuli from multiple sensory modalities.

Purpose of the Study:

• To investigate the influence of task-irrelevant information from visual, tactile, and auditory modalities on performance in a conflict task.
• To determine how spatial information from different sensory modalities interacts and affects cognitive processing.

Main Methods:

• Participants performed a visual Simon task with either tactile or auditory stimulation presented concurrently.
• Response congruency between visual and non-visual stimuli was manipulated.
• Data were analyzed using an extended Diffusion Model for Conflict Tasks (DMC), termed the Multimodal Diffusion Model for Conflict Tasks (MDMC).

Main Results:

• Visual task-irrelevant information consistently produced congruency effects, slowing and reducing accuracy.
• Tactile task-irrelevant stimulation also yielded smaller congruency effects.
• Auditory task-irrelevant stimulation produced the least pronounced effects, with neutral conditions showing the longest reaction times.

Conclusions:

• Spatial processing is more influenced by visual and tactile information than auditory information when multiple irrelevant stimuli are present.
• Task-irrelevant information from different sensory modalities appears to superimpose and automatically influence cognitive control.
• The MDMC model provides a good fit to the data, supporting the integration of multimodal irrelevant information.