Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

52
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
52
Regression Toward the Mean01:52

Regression Toward the Mean

6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Psychology as a Science01:13

Psychology as a Science

694
Psychology, as a scientific discipline, aims to understand the mind and behavior through rigorous and systematic methods. The foundation of psychological research is evidence-based, relying heavily on the scientific method to derive and validate knowledge. This structured approach ensures that findings are reliable, valid, and applicable to broader contexts.
The scientific method in psychology involves six critical steps: making observations, formulating hypotheses, conducting tests, analyzing...
694

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A reporting checklist for large language models in behavioural science.

Nature human behaviour·2026
Same author

State media control influences large language models.

Nature·2026
Same author

Investigating the analytical robustness of the social and behavioural sciences.

Nature·2026
Same author

Individual Brain Charting: fifth release of high-resolution fMRI data for cognitive mapping.

Scientific data·2026
Same author

Assessing the Impact of Sociodemographic Factors on Artificial Intelligence Models in Predicting Dementia: Retrospective Cohort Study.

JMIR medical informatics·2026
Same author

Ethical dilemmas in the use of artificial intelligence in transfusion medicine.

Vox sanguinis·2026
Same journal

Erratum for the Research Article "Assessing the health risks of rice cadmium content standards in China" by H. Chu <i>et al</i>.

Science advances·2026
Same journal

Erratum for the Research Article "Developmental regulation of Erk signaling by mitotic kinases" by F. Chen <i>et al</i>.

Science advances·2026
Same journal

Magnetically levitated metasurface enabling tangible and bidirectional human-machine interaction.

Science advances·2026
Same journal

A general photoinduced manganese-catalyzed platform for the sequential difunctionalization of [1.1.1]propellane.

Science advances·2026
Same journal

Turning sound and force into light with AlN:Mn<sup>2+</sup> mechanoluminescence.

Science advances·2026
Same journal

Extreme dominance of Earth-origin heavy ions in the intense ring current near the Earth during the May 2024 super geomagnetic storm.

Science advances·2026
See all related articles
  1. Home
  2. Reforms: Consensus-based Recommendations For Machine-learning-based Science.
  1. Home
  2. Reforms: Consensus-based Recommendations For Machine-learning-based Science.

Related Experiment Video

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.5K

REFORMS: Consensus-based Recommendations for Machine-learning-based Science.

Sayash Kapoor1,2, Emily M Cantrell3,4, Kenny Peng5

  • 1Department of Computer Science, Princeton University, Princeton, NJ 08544, USA.

Science Advances
|May 1, 2024

View abstract on PubMed

Summary
This summary is machine-generated.

Failures in machine learning (ML) validity and reproducibility are common across sciences. The REFORMS checklist offers clear guidelines for conducting and reporting ML-based science to improve rigor and credibility.

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

548
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.4K

Related Experiment Videos

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.5K
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

548
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.4K

Area of Science:

  • Cross-disciplinary application of machine learning in scientific research.

Background:

  • Widespread adoption of machine learning (ML) methods in science is hindered by frequent failures in validity, reproducibility, and generalizability.
  • These failures impede scientific progress, foster consensus around incorrect findings, and damage the credibility of ML-driven research.
  • Consistent patterns of ML application failures are observed across diverse scientific disciplines.

Purpose of the Study:

  • To provide actionable recommendations for the rigorous application and transparent reporting of machine learning in scientific research.
  • To address the common pitfalls encountered in ML-based scientific studies across various fields.

Main Methods:

  • Development of the REFORMS checklist (Recommendations for Machine-learning-based Science) based on an extensive literature review.
  • Consensus-building process involving 19 researchers from computer science, data science, mathematics, social sciences, and biomedical sciences.
  • Checklist comprises 32 questions and accompanying guidelines.
  • Main Results:

    • The REFORMS checklist offers a structured approach to enhance the quality of ML-based scientific research.
    • Guidelines are designed to improve validity, reproducibility, and generalizability of ML applications.
    • The checklist was developed through a rigorous, interdisciplinary consensus process.

    Conclusions:

    • The REFORMS checklist serves as a vital resource for researchers designing and executing studies.
    • It aids peer reviewers in evaluating the methodological soundness of ML-based research.
    • Journals can utilize REFORMS to enforce higher standards for transparency and reproducibility in scientific publications.