Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

13.2K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
13.2K
Multiple Comparison Tests01:13

Multiple Comparison Tests

4.0K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
4.0K
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

22
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
22
Bonferroni Test01:10

Bonferroni Test

2.9K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.9K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

314
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
314
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

6.0K
One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
6.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Polychoric correlations under the assumption of elliptical latent traits.

The British journal of mathematical and statistical psychology·2026
Same author

On the uncanny relationship between nonnormality and moderated multiple regression.

Psychological methods·2025
Same author

The Role of Intention, Behavioral Regulation, and Physical Activity Behavior in the Prediction of Physical Activity Identity across Time.

Behavioral sciences (Basel, Switzerland)·2024
Same author

Many nonnormalities, one simulation: Do different data generation algorithms affect study results?

Behavior research methods·2024
Same author

The case for the curve: Parametric regression with second- and third-order polynomial functions of predictors should be routine.

Psychological methods·2023
Same author

Generalized measurement error: Intrinsic and incidental measurement error.

PloS one·2023

Related Experiment Video

Updated: Sep 26, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K

The Importance of Thinking Multivariately When Setting Subscale Cutoff Scores.

Edward Kroc1, Oscar L Olvera Astivia2

  • 1University of British Columbia, Vancouver, British Columbia, Canada.

Educational and Psychological Measurement
|April 21, 2022
PubMed
Summary

Setting cutoff scores for classification scales sequentially reduces their ability to distinguish between groups. Researchers should consider joint threshold-setting across multiple dimensions for more informative tests.

Keywords:
classificationcutoff scoresmeasurementmultivariate analysisreliability

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

928
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.0K

Related Experiment Videos

Last Updated: Sep 26, 2025

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

4.1K
Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
09:00

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

928
Computerized Adaptive Testing System of Functional Assessment of Stroke
05:21

Computerized Adaptive Testing System of Functional Assessment of Stroke

Published on: January 7, 2019

6.0K

Area of Science:

  • Psychometrics
  • Statistical modeling
  • Multivariate analysis

Background:

  • Cutoff scores are commonly used in classification scales.
  • Univariate, sequential subscale threshold-setting is standard practice.

Purpose of the Study:

  • To quantify the loss of discriminative power from sequential cutoff score setting.
  • To highlight the geometric implications of marginal threshold-setting.
  • To recommend joint threshold-setting for improved test informativeness.

Main Methods:

  • Analytical exposition of threshold-setting properties.
  • Geometric interpretation of marginal versus joint thresholding.
  • Quantification of discriminative power loss in multidimensional settings.

Main Results:

  • Sequential univariate cutoff setting reduces classification power.
  • Marginal threshold-setting creates counterintuitive multidimensional geometry.
  • Each added subscale further diminishes the test's ability to discriminate.

Conclusions:

  • Applied researchers should adopt joint threshold-setting strategies.
  • Marginal threshold-setting compromises the validity of classification tests.
  • Joint threshold-setting ensures a more powerful and informative classification tool.