Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Bonferroni Test01:10

Bonferroni Test

The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Confidence Coefficient01:24

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under both the...
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures from...
Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Development of character strengths across the deployment cycle among U.S. Army soldiers.

Journal of personality·2020
Same author

Point-biserial correlation: Interval estimation, hypothesis testing, meta-analysis, and sample size determination.

The British journal of mathematical and statistical psychology·2019
Same author

Interval estimation for linear functions of medians in within-subjects and mixed designs.

The British journal of mathematical and statistical psychology·2019
Same author

Varying coefficient meta-analysis methods for odds ratios and risk ratios.

Psychological methods·2015
Same author

CFA with binary variables in small samples: a comparison of two methods.

Frontiers in psychology·2015
Same author

Meta-analysis methods for risk differences.

The British journal of mathematical and statistical psychology·2013
Same journal

Bayesian evaluation for latent variable models: A tutorial on computing information criteria and bayes factors with the r package bleval.

Psychological methods·2026
Same journal

A stochastic block prior for clustering in graphical models.

Psychological methods·2026
Same journal

Three-level vector autoregressive models.

Psychological methods·2026
Same journal

Scaling cognitive modeling to big data: A deep learning approach to studying individual differences in evidence accumulation model parameters.

Psychological methods·2026
Same journal

Best practices in multilevel modeling for within-cluster group comparisons: An evaluation of coding strategies reflecting group composition and heterogeneity.

Psychological methods·2026
Same journal

A unified framework for psychometrics in experimental psychology: The standardized generalized hierarchical factor model.

Psychological methods·2026
See all related articles

Related Experiment Video

Updated: Jun 8, 2026

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials
08:36

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials

Published on: April 19, 2024

Varying coefficient meta-analytic methods for alpha reliability.

Douglas G Bonett1

  • 1Department of Statistics, Iowa State University, Ames, IA 50011, USA. dgbonett@iastate.edu

Psychological Methods
|September 22, 2010
PubMed
Summary
This summary is machine-generated.

New confidence intervals improve reliability estimates in meta-analyses. These methods address limitations of fixed-effects (FE) and random-effects (RE) models, offering better accuracy for reliability coefficients.

More Related Videos

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Related Experiment Videos

Last Updated: Jun 8, 2026

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials
08:36

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials

Published on: April 19, 2024

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Area of Science:

  • Psychometrics
  • Statistical Modeling
  • Meta-Analysis

Background:

  • Conventional fixed-effects (FE) and random-effects (RE) confidence intervals for average reliability coefficients have significant limitations.
  • FE models assume equal reliability across studies, failing under minor assumption violations.
  • RE models assume random sampling from a normal superpopulation, performing poorly with non-normal or non-randomly sampled studies.

Purpose of the Study:

  • To introduce a novel confidence interval for average reliability coefficients using a varying coefficient statistical model.
  • To propose new methods for assessing reliability moderator effects.
  • To provide improved tools for meta-analyses, particularly those with few, carefully selected studies.

Main Methods:

  • Development of a new confidence interval based on a varying coefficient statistical model.
  • Implementation of methods to assess reliability moderator effects.
  • Evaluation of the proposed methods under conditions of reliability heterogeneity and nonrandom sampling.

Main Results:

  • The new confidence interval demonstrates strong performance under realistic conditions of reliability heterogeneity and nonrandom study sampling.
  • The proposed methods effectively assess reliability moderator effects.
  • The new approach offers a more accurate reliability estimate and better detection of moderating factors.

Conclusions:

  • The varying coefficient model provides a superior approach to confidence intervals for average reliability coefficients compared to FE and RE methods.
  • The proposed methods are particularly valuable for meta-analyses involving small, selected study samples.
  • These advancements enhance the accuracy and interpretability of reliability estimates in meta-analytic research.