Related Experiment Video
Updated: Sep 26, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores
Edward Kroc1, Oscar L Olvera Astivia2
1University of British Columbia, Vancouver, British Columbia, Canada.
Setting cutoff scores for classification scales sequentially reduces their ability to distinguish between groups. Researchers should consider joint threshold-setting across multiple dimensions for more informative tests.
Area of Science:
- Psychometrics
- Statistical modeling
- Multivariate analysis
Background:
- Cutoff scores are commonly used in classification scales.
- Univariate, sequential subscale threshold-setting is standard practice.
Purpose of the Study:
- To quantify the loss of discriminative power from sequential cutoff score setting.
- To highlight the geometric implications of marginal threshold-setting.
- To recommend joint threshold-setting for improved test informativeness.
Main Methods:
- Analytical exposition of threshold-setting properties.
- Geometric interpretation of marginal versus joint thresholding.
- Quantification of discriminative power loss in multidimensional settings.
Main Results:
- Sequential univariate cutoff setting reduces classification power.
- Marginal threshold-setting creates counterintuitive multidimensional geometry.
- Each added subscale further diminishes the test's ability to discriminate.
Conclusions:
- Applied researchers should adopt joint threshold-setting strategies.
- Marginal threshold-setting compromises the validity of classification tests.
- Joint threshold-setting ensures a more powerful and informative classification tool.
More Related Videos
Related Concept Videos
Reliability and Validity
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Theory of Attribution II: Kelley's Covariation Theory
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Friedman Two-way Analysis of Variance by Ranks
One-Way ANOVA: Unequal Sample Sizes

