Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Predicting Reaction Outcomes

Predicting Reaction Outcomes

Kinetics describes the rate and path by which a reaction occurs. In contrast, thermodynamics deals with state functions and describes the properties, behavior, and components of a system. It is not concerned with the path taken by the process and cannot address the rate at which a reaction occurs. Although it does provide information about what can happen during a reaction process, it does not describe the detailed steps of what appears on an atomic or a molecular level. On the other hand,...

Systematic Error: Methodological and Sampling Errors

Systematic Error: Methodological and Sampling Errors

In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...

Elaborative Rehearsals

Elaborative Rehearsals

Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...

Propagation of Uncertainty from Systematic Error

Propagation of Uncertainty from Systematic Error

The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this...

Random and Systematic Errors

Random and Systematic Errors

Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Spatially explicit power analysis reveals challenges for a long-term threatened species monitoring program in Australia.

Ecological applications : a publication of the Ecological Society of America·2026

Same author

AI-assisted teams outperform AI-led teams but not human-only teams in assessing research reproducibility in quantitative social science.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same author

Trait-mediated interactions drive local diversity.

Proceedings of the National Academy of Sciences of the United States of America·2026

Same author

Everyone I Don't Like Is Biased: Affective Evaluations and the Bias Blind Spot.

Personality & social psychology bulletin·2026

Same author

To what extent is air pollution associated with cardiorespiratory hospitalisations across Australia? A whole-of-population ecological study.

Public health research & practice·2026

Same author

Arts-based approaches to climate change, mental health and (un)natural disasters: a scoping review.

Arts & health·2026

Same journal

Mental health of healthcare workers in England during the first three years of the COVID-19 pandemic: The NHS CHECK study cohort.

PloS one·2026

Same journal

Research on trajectory tracking control of tracked vehicles based on hydraulic motor system identification and Laguerre-MPC.

PloS one·2026

Same journal

A collaborative cervical precancer screening strategy with concurrent HPV genotyping and visual inspection using alumni of a training centre across Ghana: The Rotary 'Protect Your Pearl' initiative.

PloS one·2026

Same journal

Removal efficiency of pesticide residues on pesticide-spiked Perilla Leaf and Broccoli surfaces using microplasma-treated water.

PloS one·2026

Same journal

Cross-domain zero-shot semantic segmentation for unstructured environments via EVA-CLIP model, ensemble prompt engineering, and optimized text-image matching.

PloS one·2026

Same journal

Adaptive robust sparse representation for face recognition based on weighted and fusion dictionary.

PloS one·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Aug 12, 2025

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

Predicting reliability through structured expert elicitation with the repliCATS (Collaborative Assessments for

Hannah Fraser¹, Martin Bush¹, Bonnie C Wintle^1,2

¹MetaMelb Lab, University of Melbourne, Melbourne, Victoria, Australia.

|January 26, 2023

Summary

This summary is machine-generated.

Predicting research replicability is crucial due to high replication costs. The repliCATS (Collaborative Assessments for Trustworthy Science) process, a structured expert elicitation method, accurately predicts study replicability, offering a cost-effective alternative.

More Related Videos

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Published on: April 28, 2016

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Published on: May 9, 2019

Related Experiment Videos

Last Updated: Aug 12, 2025

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study

Published on: January 31, 2014

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Examining Recall Memory in Infancy and Early Childhood Using the Elicited Imitation Paradigm

Published on: April 28, 2016

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Dissociation of the Confounding Influences of Expectancy and Integrative Difficulty Residing in Anomalous Sentences in Event-related Potential Studies

Published on: May 9, 2019

Area of Science:

Social and Behavioural Sciences
Scientific Methodology
Research Integrity

Background:

Replicating individual studies is resource-intensive, necessitating methods to predict research replicability.
Existing techniques for predicting replicability may not meet accuracy standards.
Ensuring the trustworthiness of scientific claims is paramount in research.

Purpose of the Study:

To introduce and validate the repliCATS (Collaborative Assessments for Trustworthy Science) process for predicting research replicability.
To provide a cost-effective method for evaluating scientific claims without full replication.
To assess the scalability and potential applications of the repliCATS process.

Main Methods:

The repliCATS process employs a structured expert elicitation approach, utilizing a modified Delphi technique.
Experts evaluate research claims within the social and behavioural sciences.
An online elicitation platform facilitates the assessment of a high volume of research claims.

Main Results:

A validation study demonstrated the repliCATS process achieved 84% classification accuracy and an Area Under the Curve of 0.94.
This accuracy meets or exceeds other known techniques for predicting replicability.
The process is highly scalable, having assessed 3000 research claims over 18 months.

Conclusions:

The repliCATS process offers a valid, accurate, and scalable method for predicting research replicability.
It provides insights into the generalizability of scientific claims through qualitative data collection.
Potential applications include alternative peer review and optimizing replication study allocation.