Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Learning Disabilities01:25

Learning Disabilities

76
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
76
Language and Cognition01:27

Language and Cognition

301
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
301

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A novel class-attention transformer-driven feature fusion technique-based speech disorder classification.

Frontiers in medicine·2026
Same author

Diabetic retinopathy severity detection using an improved Whale optimization algorithm and convolutional Kolmogorov-Arnold network.

Frontiers in medicine·2026
Same author

A Novel Hybrid CNN-ViT-Based Bi-Directional Cross-Guidance Fusion-Driven Breast Cancer Detection Model.

Life (Basel, Switzerland)·2026
Same author

Hybrid GAN-LSTM framework for diabetic foot ulcer image synthesis and automated diagnosis.

Frontiers in medicine·2026
Same author

Vision transformers- Kolmogorov-Arnold networks-based consumer driven surface cracks classification model.

Scientific reports·2026
Same author

Lightweight semantic compression visual cryptography for secure medical image transmission in IoT systems.

Scientific reports·2025

Related Experiment Video

Updated: May 20, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

641

Lightweight hybrid transformers-based dyslexia detection using cross-modality data.

Abdul Rahaman Wahab Sait1, Yazeed Alkhurayyif2

  • 1Department of Documents and Archive, Center of Documents and Administrative Communication, King Faisal University, Al-Ahsa, 31982, Saudi Arabia. asait@kfu.edu.sa.

Scientific Reports
|May 16, 2025
PubMed
Summary

This study introduces a novel deep learning model for early dyslexia detection using MRI, EEG, and handwriting data. The model achieves 99.8% accuracy, offering a significant advancement for timely intervention and improved outcomes.

Keywords:
Cross-modalityEEGFeature fusionHandwriting imagesMRIMulti-attention mechanismsVision Transformers

More Related Videos

Assessing Dyslexia at Six Year of Age
15:00

Assessing Dyslexia at Six Year of Age

Published on: May 1, 2020

8.2K
A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
04:23

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

1.7K

Related Experiment Videos

Last Updated: May 20, 2025

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

641
Assessing Dyslexia at Six Year of Age
15:00

Assessing Dyslexia at Six Year of Age

Published on: May 1, 2020

8.2K
A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
04:23

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

1.7K

Area of Science:

  • Neuroscience
  • Machine Learning
  • Medical Imaging

Background:

  • Early dyslexia diagnosis is critical for effective intervention and improved academic/cognitive outcomes.
  • Traditional dyslexia detection methods are subjective, time-consuming, and limited in scope.
  • Deep learning models show promise for dyslexia detection but face challenges with cross-modality data and interpretability.

Purpose of the Study:

  • To develop an innovative deep learning model for precise dyslexia detection using multi-modal data.
  • To address limitations in current deep learning approaches, including feature extraction from cross-modality data, interpretability, and computational efficiency.
  • To enhance early identification and facilitate timely intervention for individuals with dyslexia.

Main Methods:

  • Proposed a hybrid transformer-based model integrating SWIN-Linformer (MRI), LeViT-Performer (handwriting), and Graph Transformer Networks (EEG).
  • Employed multi-modal attention-based feature fusion for integrating diverse data types.
  • Utilized Bayesian optimization with Hyperband (BOHB) for enhancing Dartbooster XGBoost classification and quantization-aware training for reduced computational overhead.
  • Incorporated LIME and Grad-CAM for model interpretability.

Main Results:

  • Achieved a high accuracy of 99.8% in dyslexia detection across five public repositories.
  • Demonstrated superior performance compared to baseline models.
  • Showcased reduced computational overhead through quantization-aware training.
  • Validated model interpretability using LIME and Grad-CAM techniques.

Conclusions:

  • The proposed multi-modal deep learning model offers a novel and highly accurate approach to dyslexia detection.
  • The model's interpretability and computational efficiency make it suitable for practical, resource-constrained applications.
  • This advancement holds significant potential for improving early identification and intervention strategies for dyslexia.