Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Behavioral Genetics and Its Designs01:23

Behavioral Genetics and Its Designs

497
Behavior genetics explores how genetic inheritance influences human behavior. It focuses on how genes, passed from parents to offspring, contribute to the development of behavioral traits and tendencies. This branch of genetics seeks to understand the complex interplay between inherited genetic factors and environmental influences in shaping our behaviors.
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
497
Factorial Design02:01

Factorial Design

13.3K
Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...
13.3K
Multicompartment Models: Overview01:14

Multicompartment Models: Overview

252
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
252
Group Design02:01

Group Design

9.5K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
9.5K
Experimental Designs01:16

Experimental Designs

12.1K
An experimental design is a systematic process that allows researchers to evaluate the relationship between dependent and independent variables. There are three widely used types of experimental design - pre-experimental design, true experimental design, and quasi-experimental design. In pre-experimental design, the researcher compares the data before and after some interventions or treatments. The true-experimental design has more than one purposefully created group, a commonly measured...
12.1K
Multi-input and Multi-variable systems01:22

Multi-input and Multi-variable systems

147
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
147

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Neural Network Copulas for Generating Synthetic Test Data Preserving Psychometric Properties.

Journal of Intelligence·2026
Same author

Conceptual Issues in CSEM Estimation and Interpretation: Commentary on Pfadt et al.

Psychometrika·2026
Same author

Estimation of Conditional Standard Errors of Measurement for MLE Scores in MST.

Educational and psychological measurement·2026
Same author

Studying Development of Psychopathology Using Changing Measures to Account for Heterotypic Continuity.

JAACAP open·2026
Same author

Assessing the Performance of Strategies for Handling Rapid Guessing Responses in Item Response Theory Equating.

Educational and psychological measurement·2025
Same author

Evaluating Equating Methods for Varying Levels of Form Difference.

Educational and psychological measurement·2024
Same journal

A Simple Approach for Differential Test Functioning Based on Sum Scores.

Educational and psychological measurement·2026
Same journal

Evaluating Factor Retention in Large Factor Analysis Models: A Simulation Study Comparing 15 Methods.

Educational and psychological measurement·2026
Same journal

Agreement and Alignment in Binary Rating Tasks: Strategic Convergence as an Equilibrium Outcome.

Educational and psychological measurement·2026
Same journal

Interactions Between Termination Criteria and Ability Estimators in Computerized Adaptive Testing.

Educational and psychological measurement·2026
Same journal

Identification and Diagnosis of Misreporting in Surveys.

Educational and psychological measurement·2026
Same journal

The Aggregated Latent Profile Index: Measuring Person Profile Differentiation Within a Bootstrap-Validated Latent Profile Space.

Educational and psychological measurement·2026
See all related articles

Related Experiment Video

Updated: Sep 6, 2025

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills
06:52

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills

Published on: September 17, 2019

6.4K

Extended Multivariate Generalizability Theory With Complex Design Structures.

Robert L Brennan1, Stella Y Kim2, Won-Chan Lee1

  • 1The University of Iowa, Iowa City, USA.

Educational and Psychological Measurement
|June 27, 2022
PubMed
Summary
This summary is machine-generated.

This study extends multivariate generalizability theory (MGT) to complex test designs with varying random-effects structures. Accurate reliability estimates require matching the MGT model to the test

Keywords:
composite scoreserror varianceserror–tolerance ratiosmultivariate generalizability theoryrater effectsreliability coefficientstestlet effects

More Related Videos

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.0K

Related Experiment Videos

Last Updated: Sep 6, 2025

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills
06:52

Using Cholesky Decomposition to Explore Individual Differences in Longitudinal Relations between Reading Skills

Published on: September 17, 2019

6.4K
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.0K

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Modeling

Background:

  • Traditional generalizability theory (G theory) often assumes a single random-effects design.
  • Complex tests, such as mixed-format or those with testlets, may require multiple, distinct designs.
  • Existing G theory applications may not adequately capture error variance in such multifaceted assessments.

Purpose of the Study:

  • To extend multivariate generalizability theory (MGT) to accommodate tests with different random-effects designs for each level of a fixed facet.
  • To provide a framework for accurately modeling complex test structures in psychometric analysis.
  • To address potential biases in reliability estimation when test designs are multifaceted.

Main Methods:

  • Developed an extension of multivariate generalizability theory (MGT) capable of modeling tests with heterogeneous random-effects designs.
  • Applied the extended MGT framework to two real-data examples involving complex test structures.
  • Investigated the impact of design-model mismatches on estimates of error variance and reliability.

Main Results:

  • The extended MGT successfully models complex test designs with varying random-effects structures.
  • Mismatches between the specified universe of generalization and the actual complex test design can lead to biased estimates of error variance.
  • Reliability-like coefficients and error-tolerance ratios are susceptible to bias when complex test designs are oversimplified.

Conclusions:

  • Multivariate generalizability theory (MGT) can be effectively extended to handle complex test designs with multiple random-effects structures.
  • Accurate psychometric evaluations necessitate a precise alignment between the generalizability model and the intricate nature of the test.
  • Failure to account for complex designs can compromise the validity of reliability and error variance estimates in educational and psychological measurement.