Related Experiment Video
Updated: Aug 9, 2025
10:16
Synthetic, Multi-Layer, Self-Oscillating Vocal Fold Model Fabrication
Published on: December 2, 2011
14.1K
TorchDIVA: An extensible computational model of speech production built on an open-source machine learning library.
Sean P Kinahan1,2, Julie M Liss1, Visar Berisha1,2
1College of Health Solutions, Arizona State University, Tempe, Arizona, United States of America.
Plos One
|February 17, 2023
Summary
TorchDIVA, a Python-based speech motor control model, closely replicates the original DIVA model. This new implementation facilitates machine learning integration and speech quality enhancement, demonstrating its value for researchers.
Area of Science:
- Computational Neuroscience
- Speech Technology
- Machine Learning
Background:
- The DIVA model simulates speech motor control, integrating brain regions and vocal tract dynamics.
- Current implementation in Matlab Simulink limits integration with Python's extensive machine learning tools.
Purpose of the Study:
- To rebuild the DIVA model in Python using PyTorch for enhanced machine learning compatibility.
- To demonstrate TorchDIVA's capability for speech quality enhancement through generative vocoder integration.
Main Methods:
- Direct translation of DIVA source code from Matlab to Python.
- Reimplementation of Simulink signal blocks from scratch.
- Validation of TorchDIVA module accuracy against the original DIVA model.
- Integration of DiffWave, a PyTorch generative vocoder, for speech enhancement.
Main Results:
- TorchDIVA outputs closely match the original DIVA model with negligible differences.
- Improved speech quality metrics observed in DiffWave-enhanced TorchDIVA output compared to baseline.
- Successful demonstration of TorchDIVA's extensibility as a research platform.
Conclusions:
- TorchDIVA provides a valuable, Python-based platform for speech motor control research.
- The new implementation overcomes limitations of the previous Matlab version, enabling easier integration of advanced machine learning techniques.
- TorchDIVA facilitates research into speech production and quality enhancement.
More Related Videos
Related Concept Videos
01:22Language Development
420
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
420
01:27Language and Cognition
401
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
401
01:16Crossover Experiments
2.9K
Crossover experiments, also called the repeated-measurements design, is a study design in which all experimental units are exposed to all treatments in different periods. Crossover experiments are generally used in psychology, the pharmaceutical industry, agriculture, and medicine.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
2.9K
01:24Components of Language
345
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
345
01:16Control Volume and System Representations
1.2K
Two key frameworks are employed to analyze mass, energy, and momentum transfer: the control volume approach and the system approach. These frameworks offer different perspectives, depending on whether the focus is on a specific region in space (control volume approach) or a defined mass of fluid (system approach).
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
The control volume approach considers a stationary region in space through which fluid flows. This region is bounded by a control surface. For instance, in the case of water...
1.2K
01:24Facial Feedback Hypothesis
225
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
225