Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...

One-Way ANOVA: Unequal Sample Sizes

One-Way ANOVA: Unequal Sample Sizes

One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:

Measures of Intelligence

Measures of Intelligence

Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...

Ordinal Level of Measurement

Ordinal Level of Measurement

The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

On Estimating the Precision of Individual Test Scores: A Note on Pfadt, Molenaar, Hurks, and Sijtsma.

Psychometrika·2026

Same author

Proportion Explained Component Variance in Second-Order Scales: A Note on a Latent Variable Modeling Approach.

Educational and psychological measurement·2025

Same author

The One-Parameter Logistic Model Can Be True With Zero Probability for a Unidimensional Measuring Instrument: How One Could Go Wrong Removing Items Not Satisfying the Model.

Educational and psychological measurement·2025

Same author

Evaluating Change in Adjusted <i>R</i>-Square and <i>R</i>-Square Indices: A Latent Variable Method Application.

Educational and psychological measurement·2025

Same author

Fatigue in hematological cancer changes across chemotherapy trajectory within the context of IL-6, not hemoglobin level: evidence from growth curve modeling.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2025

Same author

An Omega-Hierarchical Extension Index for Second-Order Constructs With Hierarchical Measuring Instruments.

Educational and psychological measurement·2025

Search research articles

Related Experiment Video

Updated: May 28, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Scale validity evaluation with congeneric measures in hierarchical designs.

¹Michigan State University, East Lansing, USA. raykov@msu.edu

The British Journal of Mathematical and Statistical Psychology

|October 7, 2011

Summary

This study presents a validity estimation procedure for multi-component instruments in hierarchical designs using latent variable modeling. It aids in assessing criterion validity during scale development with complex data structures.

Related Experiment Videos

Last Updated: May 28, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Area of Science:

Psychometrics
Statistical Modeling

Background:

Multi-component instruments are widely used in research.
Hierarchical data structures are common in fields like education and psychology.
Estimating validity in such designs presents unique challenges.

Purpose of the Study:

To outline a procedure for validity estimation of multi-component measuring instruments in hierarchical designs.
To provide a method applicable to two-level studies for examining relationships between composite scores and criterion variables.
To facilitate obtaining estimates and confidence intervals for criterion validity coefficients during scale construction.

Main Methods:

The study employs latent variable modeling methodology.
The approach focuses on composite sum scores and criterion variables.
It is specifically designed for two-level hierarchical data.

Main Results:

The proposed procedure effectively estimates criterion validity coefficients in hierarchical designs.
Confidence intervals for validity coefficients can be obtained.
The method is demonstrated with an empirical example.

Conclusions:

The outlined procedure offers a robust approach for validity estimation in hierarchical data.
Latent variable modeling provides a suitable framework for this purpose.
The method is valuable for scale construction and development in complex research designs.