Allen Newell's Program of Research: The Video-Game Test

Area of Science:

• Cognitive Psychology
• Computational Science
• Scientific Methodology

Background:

• Newell (1973) identified slow progress in psychology due to binary research questions and insufficient attention to participant strategies.
• He proposed a research program focusing on computational models, in-depth task analysis, and multi-task modeling.

Purpose of the Study:

• To evaluate the extent to which current psychological research advances Newell's (1973) proposed research program.
• To assess the integration of computational modeling and strategy analysis in contemporary cognitive science.

Main Methods:

• Analysis of papers within a specific issue to assess adherence to Newell's (1973) proposed research directions.
• Qualitative assessment of the use of computational models, task specificity, and multi-task accounting in the studies.

Main Results:

• While some papers address participant strategies, many still average across them, contrary to Newell's recommendations.
• Few studies utilized computational models, and none successfully integrated task performance with human data.
• No systematic analysis of a single complex task (e.g., video games) or multi-task computational models were presented.

Conclusions:

• The papers, despite advanced methods, offer limited contributions to Newell's (1973) framework for psychological research.
• This reflects a broader trend in psychology and cognitive science, potentially exacerbating issues like replication crises.