Related Experiment Video
Updated: Apr 25, 2026
05:19
Practical Methodology of Cognitive Tasks Within a Navigational Assessment
Published on: June 1, 2015
15.6K
Assessing cognitively complex strategy use in an untrained domain.
George T Jackson1, Rebekah H Guess, Danielle S McNamara
1Institute for Intelligent Systems, University of Memphis.
Topics in Cognitive Science
|August 29, 2014
Summary
This study evaluates the Interactive Strategy Training for Active Reading and Thinking (iSTART) assessment algorithm. It shows the algorithm accurately assesses user performance on new texts without prior training.
Area of Science:
- Educational Technology
- Cognitive Science
- Human-Computer Interaction
Background:
- Accurate user performance assessment is crucial for adaptive educational systems.
- Traditional assessment algorithms often require extensive training data, limiting their flexibility.
- Intelligent tutoring systems need to adapt to new content without retraining.
Purpose of the Study:
- To evaluate the performance of the iSTART assessment algorithm on untrained texts.
- To determine if iSTART can accurately assess cognitive complexity in student self-explanations for novel content.
- To validate the iSTART algorithm against human expert ratings.
Main Methods:
- Students used the iSTART system to self-explain newly added texts.
- iSTART generated automated assessments of cognitive complexity for these self-explanations.
- Human experts independently rated the cognitive complexity of the same self-explanations.
- A comparative analysis was conducted between iSTART's assessments and human ratings.
Main Results:
- The iSTART assessment algorithm demonstrated significant accuracy in evaluating student self-explanations from untrained texts.
- The system's cognitive complexity assessments showed strong correlation with human expert judgments.
- This indicates the algorithm's robustness and generalizability to new educational content.
Conclusions:
- The iSTART assessment algorithm is effective for evaluating user performance on novel content.
- The system's ability to generalize reduces the need for content-specific training data.
- iSTART offers a flexible and accurate solution for adaptive feedback in educational technology.
Related Concept Videos
01:25Strategies for Assessing and Addressing Confounding
581
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
581
01:21Cognitive Learning
1.6K
Cognitive learning is based on purposive behavior, incidental learning, and insight learning.
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
E. C. Tolman's theory of purposive behavior emphasizes that much behavior is goal-directed. He argued that to understand behavior, we must look at the entire sequence of actions leading to a goal. For instance, high school students study hard, not just due to past reinforcement but also to achieve the goal of getting into a good college.
Tolman introduced the idea that behavior is influenced by...
1.6K
01:26Metacognition
1.1K
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
1.1K
01:20Introduction to Cognitive Psychology
2.7K
Cognitive psychology is the field of psychology dedicated to examining how people think. It attempts to explain how and why we think the way we do by studying the interactions among human thinking, emotion, creativity, language, and problem-solving, as well as other cognitive processes. Cognitive psychology studies how information is processed and manipulated in remembering, thinking, and knowing.
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
This field emerged in the mid-20th century, following a period dominated by behaviorism, which...
2.7K
01:17Cognitivism
2.9K
Cognitive psychology emerged as a significant field in the mid-20th century. It focused on understanding humans' internal mental processes. This approach emphasizes how people perceive, remember, think, and solve problems—elements critical to human cognition.
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
Previously dominated by behaviorism, which prioritized observable behaviors and largely ignored mental processes, psychology transformed in the 1950s. Cognitive psychologists argue that understanding how we think and process...
2.9K
01:14Decision Making: Traditional Method
4.4K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.4K