Related Experiment Video
Updated: Jun 25, 2026
08:13
Using the Race Model Inequality to Quantify Behavioral Multisensory Integration Effects
Published on: May 10, 2019
Multisensory Contributions in Joint Actions: A Scoping Review
Mathilde Truffer1, Stephan Zahno1
1Institute of Sport Science, University of Bern, Bern, Switzerland.
Perceptual and Motor Skills
|June 23, 2026
Summary
Coordinating actions with others relies on integrating multiple senses. This review shows that combining visual, auditory, and haptic information generally improves joint actions, though signal reliability is key.
Area of Science:
- Cognitive Science
- Neuroscience
- Human-Computer Interaction
Background:
- Joint actions are fundamental for human interaction, requiring real-time coordination despite sensory noise and delays.
- Multisensory integration is a potential mechanism to reduce uncertainty in sensorimotor coordination.
Purpose of the Study:
- To systematically review empirical studies on how visual, auditory, and haptic information contribute to joint actions.
- To classify studies based on coordination types (emergent vs. planned) and interaction levels (co-activity, cooperation, collaboration).
Main Methods:
- Systematic literature search following PRISMA guidelines.
- Analysis of 24 eligible studies.
- Classification of studies using established taxonomies for coordination and interaction.
Main Results:
- Access to multiple sensory channels generally enhanced interpersonal coordination across different coordination types.
- Evidence suggests sensory signal weighting depends on reliability and task relevance.
- Few studies directly test multisensory integration principles or explore learning in this context.
Conclusions:
- Multisensory integration plays a significant role in enhancing joint action coordination.
- Further research is needed to explore integration mechanisms and training-related changes in multisensory joint actions.
- Findings have implications for sports, rehabilitation, and human-robot interaction.
Related Concept Videos
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:09Functional Classification of Joints
Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An immobile...
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An immobile...
01:15Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
01:31What is a Sensory System?
Sensory systems detect stimuli—such as light and sound waves—and transduce them into neural signals that can be interpreted by the nervous system. In addition to external stimuli detected by the senses, some sensory systems detect internal stimuli—such as the proprioceptors in muscles and tendons that send feedback about limb position.
01:33Somatosensation
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
01:20Structural Classification of Joints
Joints, also known as articulations, are classified based on their structural characteristics, i.e., based on whether the articulating surfaces of the adjacent bones are directly connected by fibrous connective tissue or cartilage, or whether the articulating surfaces contact each other within a fluid-filled joint cavity. These differences serve to divide the joints of the body into three structural classifications.
A fibrous joint is where the adjacent bones are united by fibrous connective...
A fibrous joint is where the adjacent bones are united by fibrous connective...