Measuring object recognition ability: Reliability, validity, and the aggregate z-score approach
Conor J R Smithson1, Jason K Chow2, Ting-Yun Chang2,3
1Department of Psychology, Vanderbilt University, Nashville, TN, USA. conor.smithson@vanderbilt.edu.
Behavior Research Methods
|March 4, 2024
Summary
Measuring object recognition ability (o) is essential. Aggregating scores from just two tests provides a reliable estimate of this domain-general ability, making it more accessible for future research.
Area of Science:
- Cognitive psychology
- Neuroscience
Background:
- Accurate measurement of domain-general object recognition ability (o) is crucial but often requires extensive testing.
- Existing methods, like latent variable modeling, can be time-consuming and sample-intensive.
Purpose of the Study:
- To develop and validate an efficient and reliable measure of domain-general object recognition ability.
- To assess the test-retest reliability and stability of the proposed measure over time.
Main Methods:
- Utilized existing data to evaluate aggregate scores from object recognition tests as approximations of factor scores.
- Developed revised, time-efficient tests and an "odd one out" task with diverse stimuli.
- Administered revised tests to 163 participants on two occasions, one month apart, for reliability assessment.
Main Results:
- Aggregate scores from two object recognition tests correlated highly (r = .79 to .87) with factor scores from larger test batteries.
- The short aggregate measure demonstrated good test-retest reliability (r = .77).
- Structural equation modeling confirmed that the tests loaded onto a single latent variable, showing high stability (r = .93).
Conclusions:
- Score aggregation is an efficient method for estimating domain-general object recognition ability.
- The developed short measure is reliable and stable, facilitating future research on individual differences in object recognition.
Related Concept Videos
Introduction to z Scores
384
A z score (or standardized value) is measured in units of the standard deviation. It indicates how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
z scores...
384
z Scores and Unusual Values
9.7K
The z score is one of the three measures of relative standing. It describes the location of a value in a dataset relative to the mean. z scores are obtained after the standardization of the values in a dataset. The z score for the mean is 0.
This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...
This score indicates how far a value is from the mean in terms of standard deviation. For example, if a data value has a z score of +1, the researcher can infer that the particular data value is one standard deviation above the mean. If another data...
9.7K
Measures of Intelligence
7.2K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.2K
z Scores and Area Under the Curve
10.5K
z scores are the standardized values obtained after converting a normal distribution into a standard normal distribution. A z score is measured in units of the standard deviation. The z score tells you how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a z score of...
10.5K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K


