Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.4K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.4K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

193
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
193
One-Way ANOVA01:18

One-Way ANOVA

8.1K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
8.1K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

283
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
283
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

4.1K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

83
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
83

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Explainable deep learning enhances robust and reliable real-time monitoring of a chromatographic protein A capture step.

Biotechnology journal·2024
Same author

Applications of monitoring and tracing the evolution of clustering solutions in dynamic datasets.

Journal of applied statistics·2023
Same author

Validation of the Collaborative Outcomes study on Health and Functioning during Infection Times (COH-FIT) questionnaire for adults.

Journal of affective disorders·2022
Same author

clusTransition: An R package for monitoring transition in cluster solutions of temporal datasets.

PloS one·2022
Same author

Score-based measurement invariance checks for Bayesian maximum-a-posteriori estimates in item response theory.

The British journal of mathematical and statistical psychology·2022
Same author

The collaborative outcomes study on health and functioning during infection times in adults (COH-FIT-Adults): Design and methods of an international online survey targeting physical and mental health effects of the COVID-19 pandemic.

Journal of affective disorders·2021

Related Experiment Video

Updated: Aug 30, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.6K

Against the "one method fits all data sets" philosophy for comparison studies in methodological research.

Carolin Strobl1, Friedrich Leisch2

  • 1Department of Psychology, University of Zurich, Zurich, Switzerland.

Biometrical Journal. Biometrische Zeitschrift
|September 2, 2022
PubMed
Summary

This study questions the common goal of finding the "best performing" method in comparative research. It argues for a more informative research question to advance methodological understanding.

Keywords:
comparison studiesmetalearningsimulation studies

More Related Videos

Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View
05:26

Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View

Published on: January 7, 2019

6.8K
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K

Related Experiment Videos

Last Updated: Aug 30, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
08:12

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments

Published on: March 1, 2022

2.6K
Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View
05:26

Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View

Published on: January 7, 2019

6.8K
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
08:27

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

7.0K

Area of Science:

  • Methodological research
  • Comparative studies
  • Statistical analysis

Background:

  • Methodological comparison studies often seek a single
  • best performing
  • method across diverse datasets.
  • This approach may oversimplify complex research landscapes and limit nuanced understanding.

Purpose of the Study:

  • To critically evaluate the prevalent research question of identifying the single best performing method.
  • To propose and advocate for a more informative and appropriate research question in methodological studies.
  • To outline how this alternative research question can be effectively investigated.

Main Methods:

  • Conceptual analysis of existing research questions in methodological comparison studies.
  • Argumentation for the limitations of the "best performing" method paradigm.
  • Proposal of an alternative research framework and investigation strategy.

Main Results:

  • The current focus on identifying the "best performing" method is based on potentially unwarranted assumptions.
  • A shift towards a different research question offers greater insight into methodological performance.
  • The proposed alternative research question can be productively explored.

Conclusions:

  • Rethinking the primary research question in methodological studies is crucial for advancing the field.
  • A more nuanced approach to comparing methods yields more valuable and applicable insights.
  • Future methodological research should prioritize questions that foster deeper understanding over simple rankings.