Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Higher Mental Functions of the Brain: Language01:10

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Auditory Perception01:17

Auditory Perception

The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
Chunking and Rehearsal in Sensory Memory01:22

Chunking and Rehearsal in Sensory Memory

Improving short-term memory can be achieved through techniques like chunking and rehearsal. Chunking involves organizing information into larger, more manageable units. This technique is particularly useful for information that exceeds the typical memory span of between five and nine items. For instance, logging into an online account with a password like "ta89vq0179gz" involves grouping letters and numbers into three chunks—ta89, vq01, and 79gz. It makes large amounts of information more...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Self-assembled biomimetic nanocomposite integrating defect-enhanced piezoelectricity with NIR-II fluorescence and MR imaging for ultrasound-triggered piezo/chemodynamic therapy of subcutaneous glioma.

Journal of nanobiotechnology·2026
Same author

Task-dependent neural dynamics in hippocampal CA1 during auditory and visual perceptual decision-making in rats.

Brain structure & function·2026
Same author

An enhanced state convergence architecture incorporating disturbance observer for bilateral teleoperation systems.

International journal of advanced robotic systems·2026
Same author

Personalized temporal interference targeting right striatum enhances structure-function couplings in cortico-striato-thalamo-cortical network.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same author

Personalized high-intensity temporal interference stimulation decouples cerebellar networks to enhance implicit learning.

Journal of neuroengineering and rehabilitation·2026
Same author

GloW-VSNet: A scribble-based weakly supervised framework for global-view vitiligo lesion segmentation.

Medical image analysis·2025

Related Experiment Video

Updated: Jul 24, 2026

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

394

Speaker-turn aware diarization for speech-based cognitive assessments.

Sean Shensheng Xu1, Xiaoquan Ke2, Man-Wai Mak2

  • 1School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China.

Frontiers in Neuroscience
|January 31, 2024
PubMed
Summary

This study enhances speaker diarization for cognitive assessments. The new method improves accuracy in challenging conditions and can identify speaker turns, aiding analysis of speech data.

Keywords:
MOCAcomprehensive scoringdementia detectionspeaker diarizationspeaker embeddingspeaker-turn timestamps

More Related Videos

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.5K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

771

Related Experiment Videos

Last Updated: Jul 24, 2026

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

394
Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
05:48

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

1.5K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

771

Area of Science:

  • Speech processing
  • Cognitive science
  • Biomedical engineering

Background:

  • Speaker diarization is crucial for analyzing speech in cognitive assessments like the Montreal cognitive assessment (MoCA).
  • Conventional methods face challenges with acoustic mismatch and accurately identifying speaker turns in MoCA recordings.

Purpose of the Study:

  • To propose and evaluate three enhancements for speaker diarization in MoCA recordings.
  • To improve diarization accuracy and robustness against various mismatch conditions.
  • To enable speaker-turn timestamp hypothesization for datasets lacking this information.

Main Methods:

  • Utilizing multi-scale channel interdependence speaker embedding with Res2Net blocks, squeeze-and-excitation units, and channel-dependent attention.
  • Applying a sequence comparison approach for a holistic conversational view to create a speaker-turn aware scoring matrix.
  • Incorporating a pairwise similarity measure to integrate local and global information into the scoring matrix.

Main Results:

  • The proposed enhancements significantly outperform conventional x-vector/PLDA systems in speaker diarization.
  • Demonstrated superior performance under language-, age-, and microphone-mismatch scenarios.
  • Successfully hypothesized speaker-turn timestamps, enhancing applicability to diverse datasets.

Conclusions:

  • The developed speaker diarization system offers improved accuracy and robustness for cognitive impairment diagnosis from speech.
  • The method's ability to hypothesize speaker turns makes it valuable for analyzing speech datasets, even those without explicit timestamp information.