Related Experiment Video
Updated: Jun 14, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Testing the convergent validity, domain generality, and temporal stability of selected measures of people's tendency
Farid Anvari1,2,3,4, Stephan Billinger5, Pantelis P Analytis5
1Social Cognition Center Cologne, University of Cologne, Cologne, Germany. faridanvari.fa@gmail.com.
Abstract:
Given the ubiquity of exploration in everyday life, researchers from many disciplines have developed methods to measure exploratory behaviour. There are therefore many ways to quantify and measure exploration. However, it remains unclear whether the different measures (i) have convergent validity relative to one another, (ii) capture a domain general tendency, and (iii) capture a tendency that is stable across time. In a sample of 678 participants, we found very little evidence of convergent validity for the behavioural measures (Hypothesis 1); most of the behavioural measures lacked sufficient convergent validity with one another or with the self-reports. In psychometric modelling analyses, we could not identify a good fitting model with an assumed general tendency to explore (Hypothesis 2); the best fitting model suggested that the different behavioural measures capture behaviours that are specific to the tasks. In a subsample of 254 participants who completed the study a second time, we found that the measures had stability across an 1 month timespan (Hypothesis 3). Therefore, although there were stable individual differences in how people approached each task across time, there was no generalizability across tasks, and drawing broad conclusions about exploratory behaviour from studies using these tasks may be problematic. The Stage 1 protocol for this Registered Report was accepted in principle on 2nd December 2022 https://doi.org/10.6084/m9.figshare.21717407.v1 . The protocol, as accepted by the journal, can be found at https://doi.org/10.17605/OSF.IO/64QJU .
More Related Videos
Related Concept Videos
Reliability and Validity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Self-Report Tests of Personality
Longitudinal Research
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Wechsler's Contribution to Measures of Intelligence

