Shared latent representations of speech production for cross-patient speech decoding
Z Spalding1, S Duraivel1,2, S Rahimpour3,4
1Department of Biomedical Engineering, Duke University, Durham, NC, USA.
Nature Communications
|July 16, 2026
Summary
Researchers developed a new method for speech brain-computer interfaces (BCIs) by aligning neural data into a shared space. This allows combining data from multiple patients, improving BCI accuracy and deployment speed for communication restoration.
Area of Science:
- Neuroscience
- Biomedical Engineering
- Rehabilitation Technology
Background:
- Speech brain-computer interfaces (BCIs) offer communication restoration for individuals with neuromotor disorders.
- Current speech BCIs face limitations due to extensive patient-specific data requirements and long training times.
- Challenges in combining data across patients include variations in neuroanatomy and electrode placement.
Purpose of the Study:
- To develop a method for training speech BCIs using combined data from multiple patients.
- To overcome challenges associated with inter-patient variability in neural data.
- To improve the usability and accelerate the deployment of speech BCIs.
Main Methods:
- Utilized canonical correlation analysis (CCA) to align patient-specific neural data into a shared latent space.
- Employed high-density micro-electrocorticography (μECoG) for high-resolution neural recordings.
- Developed cross-patient decoding models trained on aggregated and aligned neural data.
Main Results:
- Successfully uncovered shared neural latent dynamics across patients while preserving micro-scale speech information.
- Demonstrated that cross-patient decoding models achieved improved performance compared to patient-specific models.
- The high resolution and broad coverage of μECoG facilitated enhanced model performance.
Conclusions:
- Aligning neural data to a shared latent space enables effective training of speech BCIs with multi-patient data.
- This approach significantly enhances the accuracy and deployability of speech BCIs.
- The findings pave the way for more effective communication restoration technologies, improving quality of life for individuals with communication impairments.
