Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bonferroni Test01:10

Bonferroni Test

The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Confidence Coefficient01:24

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under both the...
One-Way ANOVA01:18

One-Way ANOVA

One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
One-Way ANOVA: Unequal Sample Sizes01:15

One-Way ANOVA: Unequal Sample Sizes

One-way ANOVA can be performed on three or more samples of unequal sizes. However, calculations get complicated when sample sizes are not always the same. So, while performing ANOVA with unequal samples size, the following equation is used:
Critical Values01:31

Critical Values

A critical value is a definite value obtained from a particular probability distribution at a predecided confidence level (or a predecided significance level) for a given population parameter. The critical value provides demarcation that separates the sample statistics that are likely to occur from the ones that are unlikely to occur based on the given probability distribution and the population parameter to be estimated. The critical value for normal distribution is obtained from the z...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Meta-Analysis of Psychological and Digital Interventions to Enhance Mental Health and Well-Being in Youth: A Bayesian Umbrella Review.

Children (Basel, Switzerland)·2026
Same author

Reflections on the I-squared index for measuring inconsistency in meta-analysis.

Research synthesis methods·2026
Same author

Overcoming perfectionism during childhood and adolescence: a systematic review and meta-analysis of interventions.

Cognitive behaviour therapy·2026
Same author

Smoking cessation for people with severe mental illness: systematic review and network meta-analysis.

BMJ medicine·2026
Same author

Standardization of distance visual acuity measurement using optonet computerized vision charts: A multicentric study.

Journal of optometry·2025
Same author

Genetic association between sleep quality, insomnia, and psychological distress: a systematic review and meta-analysis.

Sleep medicine reviews·2025

Related Experiment Video

Updated: May 25, 2026

Generalized Psychophysiological Interaction (PPI) Analysis of Memory Related Connectivity in Individuals at Genetic Risk for Alzheimer's Disease
09:38

Generalized Psychophysiological Interaction (PPI) Analysis of Memory Related Connectivity in Individuals at Genetic Risk for Alzheimer's Disease

Published on: November 14, 2017

[Methods for averaging alpha coefficients in reliability generalization studies].

José A López-Pina1, Julio Sánchez-Meca, José A López-López

  • 1Facultad de Psicología, Universidad de Murcia, 30100 Murcia, Spain. jlpina@um.es

Psicothema
|January 25, 2012
PubMed
Summary

This study compares methods for reliability generalization (RG), a meta-analysis technique for test reliability. Weighted methods and specific coefficient transformations are recommended for accurate measurement error analysis.

More Related Videos

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
09:18

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting

Published on: December 15, 2023

Related Experiment Videos

Last Updated: May 25, 2026

Generalized Psychophysiological Interaction (PPI) Analysis of Memory Related Connectivity in Individuals at Genetic Risk for Alzheimer's Disease
09:38

Generalized Psychophysiological Interaction (PPI) Analysis of Memory Related Connectivity in Individuals at Genetic Risk for Alzheimer's Disease

Published on: November 14, 2017

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
09:18

Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting

Published on: December 15, 2023

Area of Science:

  • Psychometrics
  • Educational Measurement
  • Statistical Analysis

Background:

  • Reliability generalization (RG) is a meta-analytic approach to integrate independent reliability coefficients.
  • Existing methods for averaging alpha coefficients lack consensus on optimal procedures.
  • Understanding measurement error variability across studies is crucial for test application.

Purpose of the Study:

  • To compare the performance of twelve different procedures for averaging alpha coefficients within an RG framework.
  • To evaluate these procedures based on bias and mean square error using Monte Carlo simulations.
  • To identify the most effective methods for reliability generalization.

Main Methods:

  • A Monte Carlo simulation study was conducted.
  • Twelve procedures for averaging alpha coefficients were compared.
  • Procedures varied in coefficient transformation (e.g., Hakstian and Whalen, square root of inverse alpha) and weighting schemes (sample size-based).

Main Results:

  • Weighted methods generally outperformed unweighted methods in terms of bias and mean square error.
  • Transforming coefficients using the Hakstian and Whalen proposal or the square root of the inverse alpha coefficient was recommended.
  • The study identified specific conditions favoring certain averaging procedures.

Conclusions:

  • Weighted averaging procedures are superior to unweighted ones for reliability generalization.
  • Specific coefficient transformations enhance the accuracy of meta-analytic reliability estimates.
  • The findings inform the selection of appropriate methods for analyzing measurement error variability in test applications.