Related Experiment Video
Updated: May 28, 2026

Cross-Modal Multivariate Pattern Analysis
Published on: November 9, 2011
Does the modality effect exist? And if so, which modality effect?
1Département de Linguistique, Université du Québec à Montréal, C.P. 8888, Succursale Centre-Ville, Montréal, QC H3C 3P8, Canada. reinwein.joachim@uqam.ca
Abstract:
The modality effect is a central issue in multimedia learning [see Mayer (Cambridge University Press, 2005a), for a review]. Sweller's Cognitive Load Theory (CLT), for example, presumes that an illustrated text is better understood when presented visually rather than orally. The predictive power of CLT lies in how it links in to Baddeley's (1986) model of working memory and Penney's (Mem Cognit 17:398-442, 1989) Separate-Streams Hypothesis. Ginns's (Learn Instr 4:313-331, 2005) recent meta-analysis also supports the modality effect (d = 0.72, based on 43 independent effects). This article replicates the meta-analysis of the modality effect based on 86 independent effects (with within-study subgroups as the unit of analysis and with mean of the outcomes as the dependent measure), with results showing a reduction of the overall effect size by almost half (d = 0.38), and even more when Duval and Tweedie's Trim and Fill method is used to correct publication bias (d = 0.20). This article also widens the scope of the analysis of moderator variables (e.g. Pace of presentation, Type of visualization, Research group) as well as their potentially confounded effects. Finally, it is argued that, for theoretical reasons, the so-called modality effect cannot be based on Penney's or Baddeley's theories and must be explained in a different way.
Related Concept Videos
Sensory Modalities
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
Introduction to Special Senses
Framing Effects
Causes of Similarity-Dissimilarity Effect
Language and Cognition
Cause and Effect

