Jove
Visualize
Contact Us

Related Concept Videos

Regression Toward the Mean01:52

Regression Toward the Mean

6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Reliability and Validity01:29

Reliability and Validity

12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Corrigendum to Validation of the Camouflaging Autistic Traits Questionnaire Short Form (CATQ-SF). Comprehensive Psychiatry 135 (2024) Nov:135:152525.

Comprehensive psychiatry·2026
Same author

The shared variance amongst the measures of individual differences and trait EI: a meta-meta-analytic comparison.

Frontiers in psychology·2026
Same author

Predicting Leadership Status Through Trait Emotional Intelligence and Cognitive Ability.

Behavioral sciences (Basel, Switzerland)·2025
Same author

Estimating the Minimum Sample Size for Neural Network Model Fitting-A Monte Carlo Simulation Study.

Behavioral sciences (Basel, Switzerland)·2025
Same author

Validation of the camouflaging autistic traits questionnaire short form (CATQ-SF).

Comprehensive psychiatry·2024
Same author

Monte Carlo simulation with confusion matrix paradigm - A sample of internal consistency indices.

Frontiers in psychology·2024
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Video

Updated: Jun 7, 2025

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.5K

Evaluating The Predictive Reliability of Neural Networks in Psychological Research With Random Datasets.

Yongtian Cheng1, K V Petrides1

  • 1University College London (UCL), London, UK.

Educational and Psychological Measurement
|November 20, 2024
PubMed
Summary
This summary is machine-generated.

Neural networks can yield reliable psychological predictions with sufficient data. For continuous outcomes, over 50 samples suffice, but binary outcomes require larger sample sizes (200-500) for accurate machine learning predictions.

Keywords:
Balanced accuracyMonte Carlo simulationdecision errorpredictive resultsupervised neural network

More Related Videos

Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

995
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.3K

Related Experiment Videos

Last Updated: Jun 7, 2025

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
08:05

Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques

Published on: June 30, 2020

7.5K
Modeling the Functional Network for Spatial Navigation in the Human Brain
05:55

Modeling the Functional Network for Spatial Navigation in the Human Brain

Published on: October 13, 2023

995
Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks
11:18

Closed-loop Neuro-robotic Experiments to Test Computational Properties of Neuronal Networks

Published on: March 2, 2015

10.3K

Area of Science:

  • Psychology
  • Machine Learning
  • Statistical Modeling

Background:

  • Psychologists increasingly use predictive modeling.
  • Supervised neural networks are common for prediction tasks in psychology.
  • Concerns exist regarding neural network reliability with random datasets.

Purpose of the Study:

  • To evaluate the predictive performance of neural networks with random datasets in psychology.
  • To determine minimum sample sizes for reliable conclusions using neural networks.
  • To guide psychologists in sample size planning for machine learning applications.

Main Methods:

  • A Monte Carlo simulation study was conducted.
  • Neural networks were fitted with random datasets (no true relationship between variables).
  • Performance was assessed using metrics like balanced accuracy and Area Under the Curve (AUC).

Main Results:

  • For continuous dependent variables, sample sizes > 50 generally prevent erroneous conclusions.
  • For binary dependent variables, sample sizes of 200-500 are needed depending on the desired balanced accuracy threshold.
  • Specific sample sizes (100-500) are required for different AUC performance criteria (≥ .6 to ≥ .7).

Conclusions:

  • Neural networks can provide acceptable predictive performance in psychology when appropriate sample sizes are used.
  • The study provides empirical evidence for sample size planning in psychological research using neural networks.
  • Findings highlight the importance of sample size for ensuring the validity of machine learning-based psychological conclusions.