Summed versus estimated factor scores: Considering uncertainties when using observed scores.
1Department of Human Development and Quantitative Methodology, University of Maryland.
Psychological Methods
|February 8, 2024
Summary
This study evaluates how different observed scores estimate latent variables (LVs) and recover structural relations. Findings guide the selection of optimal scores in psychological science, considering reliability and model error.
Area of Science:
- Psychological Science
- Psychometrics
- Quantitative Psychology
Background:
- Observed scores are frequently used to represent underlying constructs in psychological research.
- Latent variables (LVs) are theoretical constructs operationalized through measurement models, commonly the common factor model.
- Understanding the performance of different observed scores is crucial for accurate representation of LVs.
Purpose of the Study:
- To evaluate the performance of various observed scores for estimating latent scores and classifying individuals.
- To assess the ability of different observed scores to recover structural relationships among latent variables.
- To account for sampling error and model error in the evaluation of observed score performance.
Main Methods:
- Review of psychometric properties of observed scores within classical test theory and common factor models.
- Conducting a simulation study to examine score performance under varying conditions.
- Analysis of two empirical examples to demonstrate score behavior with different reliability, sample sizes, and model error levels.
Main Results:
- Performance of different observed scores varies significantly depending on the specific application (e.g., estimation vs. structural recovery).
- Reliability, sample size, and model error critically influence the accuracy of latent score estimation and structural recovery.
- Certain observed scores demonstrate superior performance under specific conditions of uncertainty and measurement quality.
Conclusions:
- Provides evidence-based recommendations for selecting appropriate observed scores in psychological research.
- Highlights the importance of considering measurement error and model misspecification when using observed scores.
- Suggests future research directions for advancing the understanding and application of observed scores in latent variable modeling.
Related Concept Videos
Factorial Design
13.0K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.0K
One-Way ANOVA: Equal Sample Sizes
3.3K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.3K
One-Way ANOVA: Unequal Sample Sizes
5.8K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
5.8K
Uncertainty: Overview
555
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
555
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
One-Way ANOVA
7.9K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
7.9K


