Multimodal training using pitch gestures improves Mandarin tone recognition in noise for children with cochlear...

Area of Science:

• Audiology
• Speech and Language Pathology
• Developmental Neuroscience

Background:

• Cochlear implants (CIs) offer auditory access but challenges remain in recognizing tonal features.
• Second-language learning research indicates hand gestures can aid in acquiring tonal languages.
• Prelingually deaf children using CIs require effective strategies for auditory-visual speech perception.

Purpose of the Study:

• To evaluate the efficacy of incorporating manual pitch gestures into audiovisual training for Mandarin lexical tone recognition in prelingually deaf children with CIs.
• To compare the effectiveness of multimodal (auditory-visual + pitch gestures) versus auditory-visual training alone.

Main Methods:

• Eighteen preschool-aged CI users were divided into two groups: experimental (auditory-visual + pitch gestures) and control (auditory-visual only).
• Participants underwent eight training sessions.
• Tone identification tests were administered pre-training, during training, and post-training, including assessments in noise conditions.

Main Results:

• Both groups showed similar pre-training performance.
• The experimental group demonstrated significantly greater improvements in Mandarin tone recognition compared to the control group after training.
• The benefits were particularly notable in challenging noise conditions.

Conclusions:

• Integrating manual pitch gestures into audiovisual training enhances Mandarin lexical tone recognition for prelingually deaf children with CIs.
• This multimodal approach shows promise for improving auditory rehabilitation outcomes, especially for users of tonal languages.
• Pitch gesture production could be a valuable addition to CI rehabilitation programs.