Related Experiment Video
Updated: Jun 11, 2025

13:51
Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
19.9K
Expanding the scope: multimodal dimensions in aphasia discourse analysis-preliminary findings
Manaswita Dutta1, Bijoyaa Mohapatra2
1Department of Speech and Hearing Sciences, Portland State University, Portland, OR, United States.
Frontiers in Human Neuroscience
|October 10, 2024
Summary
Integrating multimodal communication into discourse analysis significantly improves narrative assessment for individuals with aphasia. This approach better captures their communication abilities, aiding in tailored interventions for improved outcomes.
Area of Science:
- Neurolinguistics
- Speech-Language Pathology
- Cognitive Science
Background:
- Aphasia, a language disorder post-brain injury, impairs communication and life participation.
- Traditional assessments may not fully capture the complex communication challenges faced by individuals with aphasia.
- Exploring multimodal communication in discourse analysis offers a more comprehensive assessment of narrative proficiency.
Purpose of the Study:
- To investigate the impact of incorporating multimodal communication elements into discourse analysis on the narrative outcomes of individuals with aphasia.
- To compare narrative proficiency scores using multimodal versus verbal-only assessment approaches.
- To examine the relationship between aphasia characteristics and the use of multimodal communication during storytelling.
Main Methods:
- Participants included individuals with chronic aphasia and healthy controls who completed a storytelling task.
- Macrolinguistic scores were collected using both verbal-only and multimodal scoring methods.
- Statistical analyses involved within-group, between-group, and correlational analyses to assess narrative performance and multimodal communication use.
Main Results:
- Individuals with aphasia demonstrated significantly higher macrolinguistic abilities when assessed using multimodal scoring compared to verbal-only scoring.
- Both fluent and nonfluent aphasia subtypes showed improved scores with multimodal assessment, particularly in Main Concepts.
- Meaning-laden gestures were the most prevalent nonverbal modality used, highlighting their importance in communication for individuals with aphasia.
Conclusions:
- Multimodal communication is crucial for accurately assessing discourse performance in individuals with aphasia.
- Assessment strategies should incorporate multimodal elements to gain deeper insights into linguistic abilities.
- Tailoring assessments to aphasia subtypes can inform targeted interventions and improve communication outcomes.
Related Concept Videos
Higher Mental Functions of the Brain: Language
768
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
768
Language and Cognition
332
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
332
Lateralization
311
Brain lateralization refers to the division of mental processes and functions between the two hemispheres of the brain, a phenomenon that optimizes neural efficiency and underpins complex abilities in humans. This specialization allows each hemisphere to perform tasks where it has a comparative advantage, facilitating more refined cognitive capabilities across different domains.
311
Cerebral Hemispheres
304
The human brain, a complex organ, is functionally divided into two cerebral hemispheres—left and right. These hemispheres are interconnected by a structure of paramount importance, the corpus callosum. This substantial bundle of neural fibers is not just a bridge between the hemispheres but a crucial element for the brain's comprehensive functioning. It enables efficient communication between the two hemispheres, allowing each side of the brain to control and receive sensory and motor...
304

