Related Experiment Video
Updated: Aug 9, 2025

Generating Strictly Controlled Stimuli for Figure Recognition Experiments
Published on: March 18, 2019
A Log File Analysis on the Validity of Partial Solutions in Figural Matrices Tests.
Dominik Weber1, Florian Krieger2, Frank M Spinath1
1Department of Individual Differences & Psychodiagnostics, Saarland University, Campus A1 3, D-66123 Saarbrücken, Germany.
New scoring methods for figural matrices tests, like the partial solution procedure, offer deeper insights into reasoning abilities. This approach better predicts academic success (Grade Point Average) than traditional methods, especially for lower-ability individuals.
Area of Science:
- Cognitive psychology
- Educational assessment
- Psychometrics
Background:
- Figural matrices tests are key components of intelligence batteries, assessing reasoning.
- Traditional scoring relies on the total solution procedure (sum of correct items).
- Computer-based tests enable novel scoring indicators through log file analysis.
Purpose of the Study:
- To evaluate the added value of a partial solution procedure in computer-based figural matrices tests.
- To explore the internal and external validity of this novel scoring method.
Main Methods:
- Two studies were conducted (n=198 and n=169).
- Study 1 used sequence analyses and rule jumps to assess internal validity.
- Study 2 correlated partial and total solution procedures with Grade Point Average (GPA) for external validity.
Main Results:
- Internal validity confirmed that higher partial solution scores correlate with more structured response behavior.
- External validity showed the partial solution procedure superior to the total solution procedure in predicting GPA.
- This predictive advantage was particularly pronounced for participants with lower ability levels.
Conclusions:
- The partial solution procedure offers valuable insights beyond traditional scoring in figural matrices tests.
- This method enhances the assessment of reasoning and predicts academic performance more effectively.
- Findings suggest broader applicability of partial solution procedures in other cognitive assessments.
Related Concept Videos
Wald-Wolfowitz Runs Test II
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
Data Validation
Key parameters for method validation include:
Normal and Tangetial Components: Problem Solving
Relative Motion Analysis using Rotating Axes-Problem Solving
Here, in order to determine the magnitude of velocity and acceleration for point...
Wald-Wolfowitz Runs Test I
The test works...
Compacting Factor test
The procedure begins by placing concrete into the upper hopper without any compaction. Once filled, the bottom door of this hopper is opened,...

