Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Case Studies01:22

Case Studies

11.7K
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
11.7K
Naturalistic Observations02:30

Naturalistic Observations

15.6K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.6K
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

73
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
73
Cross-Sectional Research01:50

Cross-Sectional Research

11.4K
In cross-sectional research, a researcher compares multiple segments of the population at the same time. If they were interested in people's dietary habits, the researcher might directly compare different groups of people by age. Instead of following a group of people for 20 years to see how their dietary habits changed from decade to decade, the researcher would study a group of 20-year-old individuals and compare them to a group of 30-year-old individuals and a group of 40-year-old...
11.4K
One-Way ANOVA: Equal Sample Sizes01:15

One-Way ANOVA: Equal Sample Sizes

3.4K
One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
3.4K
One-Way ANOVA01:18

One-Way ANOVA

8.1K
One-way ANOVA analyzes more than three samples categorized by one factor. For example, it can compare the average mileage of sports bikes. Here, the data is categorized by one factor - the company. However, one-way ANOVA cannot be used to simultaneously compare the sample mean of three or more samples categorized by two factors. An example of two factors would be sports bikes from different companies driven in different terrains, such as a desert or snowy landscape. Here, two-way ANOVA is used...
8.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Mental Health Outcomes of Foster and Adopted Individuals with Adverse Childhood Experiences: A Validation of Known Risks Using EHR Data.

medRxiv : the preprint server for health sciences·2026
Same author

Before Birth, Beyond Childhood: Understanding the Influence of Prenatal Substance Exposure on Psychiatric Diagnoses.

medRxiv : the preprint server for health sciences·2026
Same author

Gastrointestinal bleeding risk among antithrombotics users: a propensity score matched study of drug classes.

Expert opinion on drug metabolism & toxicology·2026
Same author

Ensemble of Time-Evolving SASP Gene Sets Identifies IGFBP7 and CDKN1A as a Potential Marker Pair for Senescent Fibroblast Subpopulations Across Tissues.

International journal of molecular sciences·2026
Same author

Gender differences in a causal model of risk factors underlying early alcohol sipping.

Child and adolescent psychiatry and mental health·2026
Same author

Select Small Non-Coding RNAs Are Determinants of Survival in Older Adults.

Aging cell·2026
Same journal

Characterizing facilitators and barriers to Hypoglycemic Confidence among patients with diabetes: a qualitative descriptive study.

Frontiers in psychology·2026
Same journal

Psychometric evaluation and refinement of the 7DHW questionnaire for the German population.

Frontiers in psychology·2026
Same journal

Editorial: Ethical leadership and workplace equity: mediating and moderating mechanisms in emotional labor and well-being.

Frontiers in psychology·2026
Same journal

How organizational support promotes teacher professional recognition: a perspective on teachers' autonomous learning and teaching abilities.

Frontiers in psychology·2026
Same journal

From "performance competition arena" to "psychological exemption zone": psychological safety mechanisms in reverse mobility.

Frontiers in psychology·2026
Same journal

General and sport-specific mental toughness in university students: associations with personality traits and physical activity.

Frontiers in psychology·2026
See all related articles

Related Experiment Video

Updated: Aug 8, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.6K

One data set, many analysts: Implications for practicing scientists.

Erich Kummerfeld1, Galin L Jones2

  • 1Institute for Health Informatics, University of Minnesota, Minneapolis, MN, United States.

Frontiers in Psychology
|March 3, 2023
PubMed
Summary
This summary is machine-generated.

Researchers often make subjective data analysis choices, leading to varied results. This study identifies three common pitfalls in the "many-analysts" problem and offers solutions to improve reproducibility in scientific findings.

Keywords:
data analysismetasciencemultilab analysisreproducibilitystatistical problem-solving process

More Related Videos

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

1.2K
Facilitating the Analysis of Immunological Data with Visual Analytic Techniques
10:58

Facilitating the Analysis of Immunological Data with Visual Analytic Techniques

Published on: January 2, 2011

10.2K

Related Experiment Videos

Last Updated: Aug 8, 2025

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
07:35

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

7.6K
Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches
09:47

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

1.2K
Facilitating the Analysis of Immunological Data with Visual Analytic Techniques
10:58

Facilitating the Analysis of Immunological Data with Visual Analytic Techniques

Published on: January 2, 2011

10.2K

Area of Science:

  • Data Science
  • Statistical Analysis
  • Research Methodology

Background:

  • Data analysis involves numerous choices, often undocumented, impacting research findings.
  • Variability in results among different research teams analyzing the same data (the 'many-analysts' problem) is a growing concern.
  • Previous studies confirmed the 'many-analysts' problem but lacked practical solutions.

Purpose of the Study:

  • To address the gap in practical solutions for the 'many-analysts' problem.
  • To identify specific pitfalls contributing to data analysis variability.
  • To provide actionable suggestions for mitigating subjective influences in data analysis.

Main Methods:

  • Review of existing literature on the 'many-analysts' problem.
  • Identification and categorization of common pitfalls in data analysis workflows.
  • Development of recommendations for enhancing transparency and reproducibility.

Main Results:

  • Three key pitfalls contributing to analysis variability were identified.
  • Specific examples of how subjective choices can alter research outcomes were highlighted.
  • Practical strategies to avoid these pitfalls were proposed.

Conclusions:

  • Addressing the identified pitfalls can significantly reduce variability in data analysis.
  • Implementing suggested practices can enhance the reliability and reproducibility of research findings.
  • Transparency in data analysis choices is crucial for scientific integrity.