Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

266
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
266
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Types of Hypothesis Testing01:11

Types of Hypothesis Testing

26.7K
There are three types of hypothesis tests: right-tailed, left-tailed, and two-tailed.
When the null and alternative hypotheses are stated, it is observed that the null hypothesis is a neutral statement against which the alternative hypothesis is tested. The alternative hypothesis is a claim that instead has a certain direction. If the null hypothesis claims that p = 0.5, the alternative hypothesis would be an opposing statement to this and can be put either p > 0.5, p < 0.5, or p...
26.7K
Statistical Hypothesis Testing01:16

Statistical Hypothesis Testing

2.0K
Hypothesis testing is a critical statistical procedure facilitating informed, evidence-based decisions. It begins with a hypothesis, which is a tentative explanation, or a prediction about a population parameter. This hypothesis can be either a null hypothesis (H0), indicating no effect or difference, or an alternative hypothesis (Ha), suggesting an effect or difference.
Statistical significance measures the probability that an observed result occurred by chance. If this probability, known as...
2.0K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

274
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
274
Errors In Hypothesis Tests01:14

Errors In Hypothesis Tests

4.4K
When performing a hypothesis test, there are four possible outcomes depending on the actual truth (or falseness) of the null hypothesis and the decision to reject or not.
4.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Correlated Residuals in Lagged-Effects Models: What They (Do Not) Represent in the Case of a Continuous-Time Process.

Multivariate behavioral research·2025
Same author

Aggregating evidence for a central theory from diverse studies using the generalized order-restricted information criterion.

Psychological methods·2025
Same author

Effectiveness of trauma-focused treatments for refugee children: a systematic review and meta-analyses.

European journal of psychotraumatology·2025
Same author

AIC-type Theory-Based Model Selection for Structural Equation Models.

Structural equation modeling : a multidisciplinary journal·2025
Same author

A tutorial on aggregating evidence from conceptual replication studies using the product Bayes factor.

Research synthesis methods·2024
Same author

Evaluation of inequality constrained hypotheses using a generalization of the AIC.

Psychological methods·2021

Related Experiment Video

Updated: Aug 22, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

653

How to Evaluate Theory-Based Hypotheses in Meta-Analysis Using an AIC-Type Criterion.

Rebecca M Kuiper1

  • 1Department of Methodology and Statistics, Utrecht University, Padualaan 14, 3584 CH Utrecht, The Netherlands.

Entropy (Basel, Switzerland)
|November 11, 2022
PubMed
Summary
This summary is machine-generated.

The generalized order-restricted information criterion (GORICA) allows researchers to test theory-based hypotheses using meta-analyzed effect sizes. This approach increases statistical power for theory evaluation and development across various scientific fields.

Keywords:
confirmatory researchinequality-constraintsinformation theoretic criteriainformative hypothesismeta-analysismodel selectionmultiple studiesorder-restricted hypothesistheory-based hypothesis

More Related Videos

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.0K
Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

3.4K

Related Experiment Videos

Last Updated: Aug 22, 2025

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
08:36

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment

Published on: April 19, 2024

653
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

6.0K
Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

3.4K

Area of Science:

  • Meta-analysis and statistical modeling
  • Interdisciplinary research applications (psychology, sociology, medicine, etc.)

Background:

  • Meta-analysis aggregates study effect sizes for overall estimates.
  • Researchers often have theory-based hypotheses involving specific effect size orderings or ranges.
  • Classical methods like null hypothesis testing may not fully capture theory-based predictions.

Purpose of the Study:

  • Introduce and illustrate the application of the generalized order-restricted information criterion (GORICA) for meta-analyzed estimates.
  • Compare GORICA with traditional null hypothesis testing and Akaike's Information Criterion (AIC).
  • Demonstrate how GORICA quantifies support for a priori theory-based hypotheses.

Main Methods:

  • Application of GORICA, an AIC-type confirmatory model selection criterion.
  • Evaluation of meta-analyzed effect sizes (e.g., standardized mean differences, odds ratios, Hedges' g) under inequality constraints.
  • Comparison of GORICA with null hypothesis testing and AIC.

Main Results:

  • GORICA enables quantification of support for theory-based hypotheses.
  • Using GORICA increases statistical power through theory-based hypotheses and combined meta-analytic sample sizes.
  • This facilitates theory evaluation and development.

Conclusions:

  • GORICA provides a powerful tool for testing specific, theory-driven predictions in meta-analysis.
  • The method enhances statistical power, aiding in evidence-based theory development and application.
  • Researchers across diverse scientific disciplines can benefit from GORICA for rigorous hypothesis testing.