Texts and pictures serve different functions in conjoint mental model construction and adaptation

Area of Science:

• Cognitive Psychology
• Educational Technology
• Multimedia Learning

Background:

• Effective multimedia learning relies on integrating textual and pictorial information.
• Understanding the distinct cognitive roles of text and images is crucial for optimizing learning materials.

Purpose of the Study:

• To investigate the differential functions of text and pictures in multimedia learning.
• To examine how text and picture processing changes during initial mental model construction versus task-adaptive specification.

Main Methods:

• Two studies involving secondary school students (ages 11-16).
• Experimentation with delayed-question versus preposed-question conditions to manipulate processing focus.
• Eye-tracking analysis to measure resource allocation between text and picture processing.

Main Results:

• Students allocated more resources to text processing during initial coherence-oriented mental model construction.
• Students allocated more resources to picture processing during task-adaptive mental model specification.
• Findings were robust and not attributable to rereading effects.

Conclusions:

• Text provides explicit conceptual guidance for building foundational understanding.
• Pictures offer flexible access to information, supporting task-specific adaptations and updates.
• Optimizing multimedia learning involves leveraging text for initial construction and images for dynamic updates.