Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Surveys

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

Theory of Attribution II: Kelley's Covariation Theory

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...

Statistical Significance

Statistical Significance

Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...

Case Studies

Case Studies

There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA: Equal Sample Sizes

One-Way ANOVA can be performed on three or more samples with equal or unequal sample sizes. When one-way ANOVA is performed on two datasets with samples of equal sizes, it can be easily observed that the computed F statistic is highly sensitive to the sample mean.
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

The relationship between dispositional mindfulness and psychological, cognitive, and functional outcomes following mild traumatic brain injury.

Neuropsychological rehabilitation·2025

Same author

Dysfunctional Beliefs and Their Psychological Pathways to Negative Symptoms and Functioning in Schizophrenia Spectrum Disorders.

Schizophrenia bulletin·2025

Same author

Every Four-Legged Animal is Not a Dog: Investigating Concussive Symptoms in a Non-Concussed Psychiatric Sample.

Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists·2025

Same author

On the ecological validity of the behavioural assessment of dysexecutive syndrome measure in mild traumatic brain injury.

Brain injury·2025

Same author

The ecological validity of two novel non-immersive virtual reality tests of attention and executive functions in an mTBI population.

Applied neuropsychology. Adult·2025

Same author

The pleasure expectancies scale (PLEX): A brief measure of expectancies for pleasure in schizophrenia.

Schizophrenia research·2025

Search research articles

Related Experiment Video

Updated: Jun 20, 2026

Improving Student Outcomes with an Adaptable Molecular Cloning Course-Based Undergraduate Research Experience

Improving Student Outcomes with an Adaptable Molecular Cloning Course-Based Undergraduate Research Experience

Published on: November 15, 2024

Does performance invalidity undermine replication? Evidence from an undergraduate student participant sample.

Melanie A Mascarenhas¹, Konstantine K Zakzanis^1,2

¹Graduate Department of Psychological Clinical Science, University of Toronto Scarborough, Toronto, Ontario, Canada.

Archives of Clinical Neuropsychology : the Official Journal of the National Academy of Neuropsychologists

|June 18, 2026

Summary

Performance invalidity, identified by Performance Validity Tests (PVTs), affects undergraduate research data quality. Incorporating PVTs enhances research transparency and reproducibility in psychological science.

Keywords:

performance invalidity performance validity tests replication replication crisis undergraduate research participants

More Related Videos

Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity

Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity

Published on: February 10, 2016

Related Experiment Videos

Last Updated: Jun 20, 2026

Improving Student Outcomes with an Adaptable Molecular Cloning Course-Based Undergraduate Research Experience

Improving Student Outcomes with an Adaptable Molecular Cloning Course-Based Undergraduate Research Experience

Published on: November 15, 2024

Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity

Use of Galvanic Skin Responses, Salivary Biomarkers, and Self-reports to Assess Undergraduate Student Performance During a Laboratory Exam Activity

Published on: February 10, 2016

Area of Science:

Psychological Science
Neuropsychology
Research Methodology

Background:

Performance invalidity is a known issue in clinical and forensic neuropsychology.
Its impact on psychological research data quality, especially with undergraduate participants, is understudied.
This raises concerns for the reproducibility of research findings.

Purpose of the Study:

To investigate if Performance Validity Tests (PVTs) can practically improve data quality in psychological research.
To assess the influence of performance invalidity on study outcomes in a research setting.
To explore the utility of established neuropsychological tools in addressing reproducibility challenges.

Main Methods:

Performance Validity Tests (PVTs) were integrated into a direct replication of a 2008 prescribed optimism study.
87 undergraduate students participated and were categorized as credible or non-credible based on PVT performance.
Analyses were conducted on the full sample and then repeated within these subgroups.

Main Results:

The replication was successful, with a large effect size (d=0.98).
17.2% of participants failed at least one PVT, indicating performance invalidity.
Credible participants showed a larger effect size (d=1.02) than the full sample, while non-credible participants showed a smaller effect (d=0.87), with a reversal in secondary analyses.
Significant differences were found between credible and non-credible subgroups on the primary outcome, despite demographic and experimental equivalence.

Conclusions:

Performance invalidity is prevalent in undergraduate research samples and can significantly impact study results.
Integrating PVTs into research protocols is a practical and scalable method to enhance data quality and transparency.
Neuropsychology's established tools, like PVTs, can offer solutions to improve the reproducibility of psychological science.