Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Causes of Similarity-Dissimilarity Effect

Causes of Similarity-Dissimilarity Effect

The similarity-dissimilarity effect, a fundamental concept in social psychology, explains how interpersonal similarities and differences influence attraction and social interactions. This effect is supported by three key psychological perspectives: balance theory, social comparison theory, and consensual validation.Balance Theory and Cognitive ConsistencyBalance theory, developed by Fritz Heider, posits that individuals seek cognitive consistency in their relationships. When two people share...

Cerebral Hemispheres

Cerebral Hemispheres

The human brain, a complex organ, is functionally divided into two cerebral hemispheres—left and right. These hemispheres are interconnected by a structure of paramount importance, the corpus callosum. This substantial bundle of neural fibers is not just a bridge between the hemispheres but a crucial element for the brain's comprehensive functioning. It enables efficient communication between the two hemispheres, allowing each side of the brain to control and receive sensory and motor...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The good and the bad: A qualitative investigation of students' perspectives on their problematic smartphone use.

Journal of behavioral addictions·2026

Same author

A next generation of the schema therapy model of personality pathology: A cross-cultural and international study protocol.

PloS one·2026

Same author

Does the Loss of Autobiographical Memories Contribute to the Therapeutic Effect of Electroconvulsive Therapy?

Acta psychiatrica Scandinavica·2026

Same author

Estimating Discrete Latent Variable Models Using Amortized Variational Inference.

Psychometrika·2026

Same author

Anatomy of a failure: a retrospective evaluation of a cognitive bias modification intervention to promote physical activity in cardiac rehabilitation.

BMJ open·2026

Same author

A One-Year longitudinal study on Surrender to God assessed during addiction treatment.

Addictive behaviors reports·2026

Same journal

Mind wandering during first- and foreign-language reading.

Psychonomic bulletin & review·2026

Same journal

Lexical word processing is unaffected by rapid invisible frequency tagging in reading: Evidence from eye movements.

Psychonomic bulletin & review·2026

Same journal

Anxiety modulates voluntary attentional orienting to emotional gaze cues: Eye movements for pro- and anti-saccades.

Psychonomic bulletin & review·2026

Same journal

Faster key-press responses to front vowels than back vowels when matching heard vowels with represented vowels.

Psychonomic bulletin & review·2026

Same journal

Testing the interleaving effect without response bias: A forced-choice reevaluation of Kornell and Bjork (2008).

Psychonomic bulletin & review·2026

Same journal

The impact of social interaction on abstract concepts.

Psychonomic bulletin & review·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Nov 2, 2025

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Published on: October 5, 2020

Methods to split cognitive task data for estimating split-half reliability: A comprehensive review and systematic

Thomas Pronk^1,2,3, Dylan Molenaar⁴, Reinout W Wiers^5,6

¹Faculty of Social and Behavioural Sciences, Department of Psychology, University of Amsterdam, P.O. Box: 15969, 1001 NL, Amsterdam, The Netherlands. t.pronk@uva.nl.

Psychonomic Bulletin & Review

|June 8, 2021

Summary

This summary is machine-generated.

Monte Carlo splitting is the most reliable method for estimating cognitive task dataset reliability. This approach minimizes confounding effects from time, task design, and scoring, offering more accurate results than other split-half techniques.

Keywords:

Cognitive tasks Confounding effects Non-linear scoring algorithms Reliability

More Related Videos

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

A Two-interval Forced-choice Task for Multisensory Comparisons

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Related Experiment Videos

Last Updated: Nov 2, 2025

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Revised and Neuroimaging-Compatible Versions of the Dual Task Screen

Published on: October 5, 2020

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

A Two-interval Forced-choice Task for Multisensory Comparisons

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

Area of Science:

Cognitive Psychology
Psychometrics
Data Science

Background:

Estimating cognitive task dataset reliability commonly uses split-half methods.
Four distinct splitting methods exist: first-second half, odd-even, permutated, and Monte Carlo.
These methods can be combined with stratification by task design.

Purpose of the Study:

To review and compare four split-half reliability estimation methods for cognitive tasks.
To assess the confounding effects of time, task design, trial sampling, and non-linear scoring on reliability estimates.
To recommend the most robust reliability estimation method based on theoretical review and empirical data.

Main Methods:

Theoretical review of four split-half methods (first-second half, odd-even, permutated, Monte Carlo) with stratification.
Analysis of confounding effects: time, task design, trial sampling, and non-linear scoring.
Empirical estimation of reliability for four cognitive task datasets using each splitting method.

Main Results:

Monte Carlo splitting, especially with stratification, is theoretically the most robust method.
Empirical analysis confirmed confounding effects, particularly from time and task design, often attenuating reliability estimates.
Findings were consistent across three datasets, with one dataset showing potential indicators for assessing split-half appropriateness.

Conclusions:

Monte Carlo splitting is recommended for reliable cognitive task data analysis.
Confounding effects significantly impact reliability estimates, necessitating careful method selection.
Further research and practical tools (R package) are suggested for improved reliability estimation.