Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

McNemar's Test01:23

McNemar's Test

161
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups when the outcome is binary (e.g., yes/no, success/failure). It is beneficial when we have paired data, such as pre-test/post-test designs, where the same subjects are measured under two different conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in situations where subjects are...
161
Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

688
Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates...
688
Self-Report Tests of Personality01:22

Self-Report Tests of Personality

310
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
310
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

176
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
176
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

150
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
150

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Restrict for Health or for Thinness? Liking but Not Approach Bias Differentiates Orthorexic Eating Behavior From Anorexia Nervosa in Responses to High-Caloric Healthy vs. High-Caloric Unhealthy Foods.

The International journal of eating disorders·2026
Same author

Singing for adults with chronic respiratory disease.

The Cochrane database of systematic reviews·2026
Same author

Bidirectional temporal relationships between emotional state and eating across eating disorders: a network approach.

Journal of eating disorders·2026
Same author

Daily Body (Dis-)Satisfaction and Dietary Restriction in Women Across the Eating Disorder Spectrum.

The International journal of eating disorders·2026
Same author

Effectiveness of a smartphone-delivered Approach-Avoidance intervention in dietary behavior - a randomized controlled trial.

The international journal of behavioral nutrition and physical activity·2025
Same author

Anxiety Symptom Severity and Implicit and Explicit Self-As-Anxious Associations in a Large Online Sample of U.S. Adults: Trends From 2011 to 2022.

Clinical psychological science : a journal of the Association for Psychological Science·2025

Related Experiment Video

Updated: Jun 9, 2025

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

10.9K

Reaction-time task reliability is more accurately computed with permutation-based split-half correlations than with

Sercan Kahveci1,2, Arne C Bathke3, Jens Blechert4,5

  • 1Department of Psychology, Paris-Lodron-University of Salzburg, Hellbrunner Straße 34, 5020, Salzburg, Austria. sercan.kahveci@plus.ac.at.

Psychonomic Bulletin & Review
|October 23, 2024
PubMed
Summary
This summary is machine-generated.

Cronbach's alpha provides inaccurate reliability estimates for reaction-time tasks. Permutation-based split-half reliability offers a more accurate method for assessing experimental paradigm reliability.

Keywords:
Cognitive tasksPsychometrics/testingReaction time analysisReliability

More Related Videos

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.5K
The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
06:43

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

16.0K

Related Experiment Videos

Last Updated: Jun 9, 2025

A Two-interval Forced-choice Task for Multisensory Comparisons
07:13

A Two-interval Forced-choice Task for Multisensory Comparisons

Published on: November 9, 2018

10.9K
How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.5K
The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
06:43

The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

Published on: July 26, 2013

16.0K

Area of Science:

  • Psychological measurement
  • Cognitive psychology
  • Psychometrics

Background:

  • Reliability reporting is standard for self-report scales but uncommon for experimental paradigms.
  • Reaction-time tasks are widely used in psychological research, necessitating accurate reliability measures.

Purpose of the Study:

  • To review and compare methods for computing reliability in reaction-time tasks.
  • To identify the most accurate reliability estimation technique for experimental paradigms.

Main Methods:

  • Simulation study comparing Cronbach's alpha and split-half reliability methods.
  • Reanalysis of existing data and literature comparison.
  • Establishing best practices for permutation-based split-half reliability via simulations.

Main Results:

  • Cronbach's alpha yields inaccurate and biased reliability estimates for reaction-time data.
  • Permutation-based split-half reliability provides substantially more accurate estimates.
  • Optimizing permutation-based split-half reliability involves equal trial distribution per stimulus, Spearman-Brown correction, and sufficient split-half computations (approx. 5,400).

Conclusions:

  • Permutation-based split-half reliability is the recommended method for assessing reaction-time task reliability.
  • Current practices using Cronbach's alpha can lead to misleading conclusions about measurement precision.
  • Guidelines are provided for maximizing the accuracy of permutation-based split-half reliability, with a review of available software.