Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Factorial Design

Factorial Design

Factorial Analysis is an experimental design that applies Analysis of Variance (ANOVA) statistical procedures to examine a change in a dependent variable due to more than one independent variable, also known as factors. Changes in worker productivity can be reasoned, for example, to be influenced by salary and other conditions, such as skill level. One way to test this hypothesis is by categorizing salary into three levels (low, moderate, and high) and skills sets into two levels (entry level...

Friedman Two-way Analysis of Variance by Ranks

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for ka Estimation

One-Compartment Open Model: Wagner-Nelson and Loo Riegelman Method for k_a Estimation

This lesson introduces two critical methods in pharmacokinetics, the Wagner-Nelson and Loo-Riegelman methods, used for estimating the absorption rate constant (ka) for drugs administered via non-intravenous routes. The Wagner-Nelson method relates ka to the plasma concentration derived from the slope of a semilog percent unabsorbed time plot. However, it is limited to drugs with one-compartment kinetics and can be impacted by factors like gastrointestinal motility or enzymatic degradation.
On...

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic Models: Compartment Models in Individual and Population Analysis

Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least squares (OLS)...

Expected Frequencies in Goodness-of-Fit Tests

Expected Frequencies in Goodness-of-Fit Tests

A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

On Estimating the Precision of Individual Test Scores: A Note on Pfadt, Molenaar, Hurks, and Sijtsma.

Psychometrika·2026

Same author

Proportion Explained Component Variance in Second-Order Scales: A Note on a Latent Variable Modeling Approach.

Educational and psychological measurement·2025

Same author

The One-Parameter Logistic Model Can Be True With Zero Probability for a Unidimensional Measuring Instrument: How One Could Go Wrong Removing Items Not Satisfying the Model.

Educational and psychological measurement·2025

Same author

Evaluating Change in Adjusted <i>R</i>-Square and <i>R</i>-Square Indices: A Latent Variable Method Application.

Educational and psychological measurement·2025

Same author

Fatigue in hematological cancer changes across chemotherapy trajectory within the context of IL-6, not hemoglobin level: evidence from growth curve modeling.

Supportive care in cancer : official journal of the Multinational Association of Supportive Care in Cancer·2025

Same author

An Omega-Hierarchical Extension Index for Second-Order Constructs With Hierarchical Measuring Instruments.

Educational and psychological measurement·2025

Search research articles

Related Experiment Video

Updated: Jul 10, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Estimation of maximal reliability for multiple-component instruments in multilevel designs.

Tenko Raykov¹, Spiridon Penev

¹Measurement and Quantitative Methods, Michigan State University, East Lansing, Michigan 48824, USA. raykov@msu.edu

The British Journal of Mathematical and Statistical Psychology

|November 16, 2007

Summary

This study introduces a new method for estimating the maximal reliability of multi-component instruments in hierarchical settings. The procedure enhances accuracy for nested data structures in research.

Related Experiment Videos

Last Updated: Jul 10, 2026

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Area of Science:

Psychometrics
Statistical Modeling
Multilevel Analysis

Background:

Assessing the reliability of multi-component instruments is crucial for accurate measurement.
Hierarchical data structures, common in social and behavioral sciences, pose unique challenges for reliability estimation.
Existing methods may not fully capture the complexities of nested data and related component performance.

Purpose of the Study:

To outline a novel procedure for point and interval estimation of maximal reliability.
To extend reliability estimation methods to multi-level settings with hierarchical data.
To provide a framework applicable to homogeneous scales with potentially related component performance.

Main Methods:

Development of a procedure within the framework of multi-level factor analysis.
Application to hierarchical designs where individuals are nested within higher-order units.
Estimation of maximal reliability using point and interval techniques.

Main Results:

A practical procedure for estimating maximal reliability in multi-level settings has been established.
The method accounts for the nested structure of data and related component performance.
The approach offers a robust way to assess instrument reliability in complex designs.

Conclusions:

The proposed multi-level factor analysis approach provides a statistically sound method for maximal reliability estimation.
This procedure is particularly valuable for research utilizing hierarchical designs.
The method enhances the validity and interpretability of measurements from multi-component instruments in nested contexts.