Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Statistical Analysis: Overview01:11

Statistical Analysis: Overview

When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test01:09

Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test

In parametric statistics, two fundamental tests stand out for their utility and wide application: the Student's t-test and goodness-of-fit tests. These tests provide researchers with a robust method for drawing insights from data, testing hypotheses, and making informed decisions based on their findings.
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with data...
Statistical Significance01:37

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance, comparing...
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Meta-Analysis of Psychological and Digital Interventions to Enhance Mental Health and Well-Being in Youth: A Bayesian Umbrella Review.

Children (Basel, Switzerland)·2026
Same author

Meta-regression with categorical moderators and dependent effect sizes: A simulation study.

Research synthesis methods·2026
Same author

Non-coding RNAs as biomarkers and therapeutic targets in pancreatic cancer: Clinical implications and translational perspectives.

Biomedicine & pharmacotherapy = Biomedecine & pharmacotherapie·2026
Same author

Overcoming perfectionism during childhood and adolescence: a systematic review and meta-analysis of interventions.

Cognitive behaviour therapy·2026
Same author

Sedentary Behavior and Low Back Pain in Children and Adolescents: A Systematic Review and Meta-Analysis.

Healthcare (Basel, Switzerland)·2026
Same author

Effectiveness of Family Intervention Programs Based on the Interpersonal Cognitive Model of Anorexia: Systematic Review and Meta-Analysis.

European eating disorders review : the journal of the Eating Disorders Association·2026
Same journal

Proficiency order invariance of MLE, MAP, EAP, and WLE in item response theory.

The British journal of mathematical and statistical psychology·2026
Same journal

Bias and precision in true-score estimation.

The British journal of mathematical and statistical psychology·2026
Same journal

Polychoric correlations under the assumption of elliptical latent traits.

The British journal of mathematical and statistical psychology·2026
Same journal

Regularized reduced rank regression for mixed predictor and response variables.

The British journal of mathematical and statistical psychology·2026
Same journal

A multiple-choice SDT model for cognitive diagnosis models.

The British journal of mathematical and statistical psychology·2026
Same journal

Modular item response and structural equation modelling via measurement and uncertainty preserving parametric modelling.

The British journal of mathematical and statistical psychology·2026
See all related articles

Related Experiment Video

Updated: May 17, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Some recommended statistical analytic practices when reliability generalization studies are conducted.

Julio Sánchez-Meca1, José Antonio López-López, José Antonio López-Pina

  • 1University of Murcia, Spain.

The British Journal of Mathematical and Statistical Psychology
|October 11, 2012
PubMed
Summary
This summary is machine-generated.

Choosing the right statistical model is crucial for reliability generalization (RG) meta-analyses. Different methods for averaging reliability coefficients significantly impact study results, especially moderator analyses.

More Related Videos

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Related Experiment Videos

Last Updated: May 17, 2026

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities
10:26

Problem-Solving Before Instruction (PS-I): A Protocol for Assessment and Intervention in Students with Different Abilities

Published on: September 11, 2021

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Area of Science:

  • Psychometrics
  • Meta-analysis
  • Statistical modeling

Background:

  • The reliability generalization (RG) meta-analytic approach lacks a universally preferred statistical method.
  • Previous research has not standardized the integration of reliability coefficients (alpha) in RG studies.
  • Varying statistical models can influence the outcomes of RG analyses.

Purpose of the Study:

  • To examine the influence of different statistical methods on results in reliability generalization (RG) studies.
  • To compare thirteen statistical models for averaging reliability coefficients and identifying moderator variables.
  • To provide guidelines for selecting appropriate statistical models in RG research.

Main Methods:

  • Analysis of five real-world RG examples.
  • Comparison of thirteen statistical models for averaging coefficients alpha.
  • Evaluation of models based on coefficient transformation and statistical approach (OLS, fixed-effect, varying coefficient, random-effects).

Main Results:

  • Significant discrepancies were observed across different statistical methods, particularly in moderator analyses.
  • The choice of model impacts the integration of reliability coefficients and the identification of moderators.
  • Random-effects (RE) models are best for generalizing to hypothetical studies.
  • Fixed-effect (FE) and varying coefficient (VC) models are suitable for generalizing to the specific studies included.

Conclusions:

  • The selection of a statistical model in RG meta-analysis should align with the intended scope of generalization.
  • RE models facilitate broader generalization, while FE and VC models offer narrower, study-specific generalization.
  • Clear guidelines are proposed to aid meta-analysts in choosing the most appropriate statistical model for their RG studies.