Jove
Visualize
Contact Us

Related Concept Videos

Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Causes of Similarity-Dissimilarity Effect01:26

Causes of Similarity-Dissimilarity Effect

The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...
Stereotypes, Prejudice, and Discrimination02:55

Stereotypes, Prejudice, and Discrimination

Humans are very diverse and although we share many similarities, we also have many differences. The social groups we belong to help form our identities (Tajfel, 1974). These differences may be difficult for some people to reconcile, which may lead to prejudice toward people who are different. Prejudice is a negative attitude and feeling toward an individual based solely on one’s membership in a particular social group (Allport, 1954; Brown, 2010). Prejudice is common against people who are...
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and Cox...
Comparing Experimental Results: Student's t-Test01:09

Comparing Experimental Results: Student's t-Test

The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Clinical trial priorities, adaptive strategies, and equitable partnerships for the Bundibugyo Ebola outbreak.

The Lancet. Infectious diseases·2026
Same author

Ebola outbreak caused by Bundibugyo virus: challenges and priorities for epidemic preparedness and response.

Lancet (London, England)·2026
Same author

Logistical Challenges in Platform Randomized Trials - Operational Realities That Curb the Promise of Efficiency.

Clinical epidemiology·2026
Same author

The Effect of Fluvoxamine and Metformin for Fatigue in Patients With Long COVID : An Adaptive Randomized Trial.

Annals of internal medicine·2026
Same author

Clade-specific ophthalmic manifestations of mpox: an umbrella review and meta-analysis of systematic reviews.

The British journal of ophthalmology·2025
Same author

Retraction notice to Effect of early treatment with metformin on risk of emergency care and hospitalization among patients with COVID-19: the TOGETHER randomized platform clinical trial [The Lancet Regional Health-Americas Volume 6, February 2022, 100142].

Lancet regional health. Americas·2025
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 4, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

Estimating the power of indirect comparisons: a simulation study.

Edward J Mills1, Isabella Ghement, Christopher O'Regan

  • 1Faculty of Health Sciences, University of Ottawa, Ottawa, Canada. Edward.mills@uottawa.ca

Plos One
|February 2, 2011
PubMed
Summary

Indirect comparisons using adjusted indirect methods show low power and under-coverage for confidence intervals, especially with unbalanced data or high heterogeneity in randomized clinical trials (RCTs). This highlights fragility in these popular evidence synthesis techniques.

More Related Videos

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Related Experiment Videos

Last Updated: Jun 4, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies
08:24

The Joint Effect of Social Comparison and Social Distance on Evaluation of Intertemporal Choice Outcomes in Event-related Potential Studies

Published on: August 25, 2023

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Area of Science:

  • Medical statistics
  • Evidence synthesis
  • Comparative effectiveness research

Background:

  • Indirect comparisons are increasingly used for medical treatments lacking head-to-head randomized clinical trials (RCTs).
  • The reliability and fragility of confidence intervals and hypothesis testing in indirect comparison methods are not well understood.

Purpose of the Study:

  • To examine the fragility of confidence interval estimation and hypothesis testing using the adjusted indirect method.
  • To assess the impact of heterogeneity and data imbalance on the performance of indirect comparisons.

Main Methods:

  • A simulation study was conducted to evaluate the adjusted indirect method.
  • The simulation examined confidence interval under-coverage and hypothesis testing power.
  • Scenarios included varying levels of between-study heterogeneity and comparison balance.

Main Results:

  • Indirect confidence interval estimation demonstrated under-coverage under moderate to large between-study heterogeneity.
  • Indirect hypothesis testing exhibited low statistical power in the presence of significant heterogeneity.
  • Overestimation risk increased substantially when one direct comparison involved only a single trial.

Conclusions:

  • Indirect comparisons generally suffer from low statistical power.
  • The risk of imprecision in indirect comparisons is amplified with unbalanced study designs.
  • Caution is advised when interpreting results from indirect comparisons, particularly those with heterogeneity or imbalance.