Related Concept Videos
Self-Report Tests of Personality
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Binet's Contribution to Measures of Intelligence
Wechsler's Contribution to Measures of Intelligence
Ratio Level of Measurement
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks...
Measuring the menu, not the food: "psychometric" data may instead measure "lingometrics" (and miss its greatest
Jan Ketil Arnulf1, Ulf Henning Olsson1, Kim Nimon2
1BI Norwegian Business School, Oslo, Norway.
View abstract on PubMed
Psychological research may be measuring semantic representations, not actual constructs. This review suggests a shift from nomological to semantic networks, impacting construct validation and empirical truth in psychometrics.
More Related Videos
12:55Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
Area of Science:
- Psychology
- Computational Linguistics
- Psychometrics
Background:
- Traditional psychometric methods rely on construct validation, often conceptualized within nomological networks.
- Empirical studies using digital text algorithms analyze human responses to Likert-scale items.
Purpose of the Study:
- To review empirical studies using text algorithms to model human responses to Likert-scale items.
- To investigate the predictability of construct validation statistics across different levels and cultures.
- To propose a shift from nomological networks to semantic networks in understanding psychological constructs.
Main Methods:
- Review of empirical studies employing digital text algorithms.
- Analysis of response patterns to Likert-scale items using text as input.
Main Results:
- Construct validation statistics are predictable at both sample and individual levels, across languages and cultures.
- Relationships between variables are often semantic and a priori computable, rather than strictly empirical.
- Psychological research consistently shows an average explained variance of 42%.
Conclusions:
- Human semantic processing is fast and intersubjectively consistent.
- A categorical error exists in psychometrics, measuring representations instead of the represented.
- The findings have significant implications for the empirical truth of traditional psychometric research.
