Modality Synchronization When People With Aphasia Read With Text-to-Speech Support.

Area of Science:

• Neuroscience
• Speech and Language Pathology
• Human-Computer Interaction

Background:

• Text-to-speech (TTS) technology offers dual-modality (auditory and visual) content presentation.
• Synchronization of eye fixations with auditory word presentation is crucial for TTS benefits in aphasia.
• Limited research exists on modality synchronization achievement in people with aphasia using TTS.

Purpose of the Study:

• To investigate the extent and frequency of modality synchronization in individuals with aphasia using TTS.
• To examine the relationship between reading comprehension, reading rate, and modality synchronization.

Main Methods:

• Retrospective analysis of eye-tracking data from nine adults with aphasia processing TTS passages.
• Modality synchronization defined as eye fixation occurring within a specific time window relative to auditory word presentation.
• Correlation analysis between synchronization percentages and standardized reading test scores.

Main Results:

• Only three participants showed consistent modality synchronization (67-76% of words).
• One participant had inconsistent synchronization (58%), while five rarely synchronized.
• A significant positive correlation was found between reading comprehension scores and modality synchronization.

Conclusions:

• A default TTS rate does not ensure dual-modality synchronization for most individuals with aphasia.
• The lack of synchronization may explain variable benefits of TTS for this population.
• Further research is needed to optimize TTS presentation for aphasia support.