Related Experiment Video
Updated: May 7, 2026

06:33
Decomposing the Variance in Reading Comprehension to Reveal the Unique and Common Effects of Language and Decoding
Published on: October 11, 2018
Comparing comprehension measured by multiple-choice and open-ended questions.
Yasuhiro Ozuru1, Stephen Briner, Christopher A Kurby
1Department of Psychology.
Summary
Open-ended questions assess text comprehension through self-explanations, while multiple-choice questions rely on prior knowledge. These distinct methods reveal different facets of reading comprehension.
Area of Science:
- Cognitive Psychology
- Educational Psychology
- Psycholinguistics
Background:
- Text comprehension is crucial for learning and knowledge acquisition.
- Assessing comprehension effectively requires understanding the underlying cognitive processes.
- Different question formats may tap into distinct cognitive mechanisms.
Purpose of the Study:
- To compare how open-ended and multiple-choice questions measure text comprehension.
- To investigate the relationship between self-explanations, prior knowledge, and question formats.
- To explore the implications for dual process theories of text comprehension.
Main Methods:
- Participants read a text and explained preselected sentences.
- Participants answered both open-ended and multiple-choice questions based on the text.
- Performance was analyzed in relation to self-explanation quality and prior knowledge.
Main Results:
- Performance on open-ended questions correlated with self-explanation quality.
- Performance on multiple-choice questions correlated with prior knowledge.
- The two question formats appear to measure different aspects of comprehension.
Conclusions:
- Open-ended questions may better reflect deeper processing and understanding.
- Multiple-choice questions might be more influenced by existing knowledge than by text processing.
- Findings support dual process theories in explaining comprehension differences.
Related Concept Videos
Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Surveys
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
Complementation Tests
A complementation test is a simple cross to identify whether the two mutations are located on the same gene or different genes. It was first performed by Edward Lewis in the 1940s while working on fruit flies. He developed the test to identify the location and arrangement of different mutations on chromosomes.
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
Organisms heterozygous for different mutations are crossed pairwise in all combinations. If present on different genes, the mutations can complement each other by providing the missing...
Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
Cochran's Q Test
Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...
Review and Preview
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...

