Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Reliability and Validity

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.

Self-Report Tests of Personality

Self-Report Tests of Personality

Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.

Self-Evaluation Maintenance Model

Self-Evaluation Maintenance Model

The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...

Multiple Regression

Multiple Regression

Multiple regression assesses a linear relationship between one response or dependent variable and two or more independent variables. It has many practical applications.
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...

Theory of Attribution II: Kelley's Covariation Theory

Theory of Attribution II: Kelley's Covariation Theory

Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...

Surveys

Surveys

Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Trial-By-Trial Changes in Neural Indices of Performance Monitoring Uniquely Correspond to Behavioral Adjustments During a Flanker Task.

Human brain mapping·2026

Same author

An Exploratory Analysis and Comparison of Post-Concussion Symptom Networks in Young Adults with and without a Remote History of Concussion.

Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists·2026

Same author

Enhancing generalizability theory with mixed-effects models for heteroscedasticity in psychological measurement: A theoretical introduction with an application from EEG data.

The British journal of mathematical and statistical psychology·2026

Same author

Beyond classical metrics: Generalizability theory across psychophysiological modalities.

International journal of psychophysiology : official journal of the International Organization of Psychophysiology·2026

Same author

Trial-by-trial ERP-behavior relationships in psychosis: Between- and within-person variability in performance monitoring adjustments.

Schizophrenia research·2025

Same author

Impact of ERP Reliability Cutoffs on Sample Characteristics and Effect Sizes: Performance-Monitoring ERPs in Psychosis and Healthy Controls.

Psychophysiology·2025

Same journal

Testing linear hypotheses in repeated measures generalized linear models using external information.

Psychometrika·2026

Same journal

When Do Unifactorial Items Increase the Reliability?

Psychometrika·2026

Same journal

Longitudinal Designs for Diagnostic Models: Identification and Estimation.

Psychometrika·2026

Same journal

Modeling Rare Events and Nonmonotone Nonignorable Missingness of Time-Varying Outcomes and Predictors in Binary Time-Series Daily Diary Data: A Bayesian Selection Model.

Psychometrika·2026

Same journal

Revelle's Beta: The Wait Is Over-Computation Becomes Possible.

Psychometrika·2026

Same journal

On dimensional implication graphs.

Psychometrika·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Sep 29, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

The Reliability Factor: Modeling Individual Reliability with Multiple Items from a Single Assessment.

Stephen R Martin¹, Philippe Rast¹

¹Department of Psychology, University of California, Davis, 135 Young Hall, 1 Shields Avenue, Davis, CA, 95616, USA.

|March 21, 2022

Summary

This summary is machine-generated.

This study introduces a new method to estimate case-specific reliability, moving beyond single fixed values. This approach models error variance to provide individualized reliability estimates without needing repeated tests.

Keywords:

Bayesian Omega reliability

More Related Videos

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

Assessment of Child Anthropometry in a Large Epidemiologic Study

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Related Experiment Videos

Last Updated: Sep 29, 2025

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits

Published on: September 27, 2019

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education

Published on: August 16, 2024

Assessment of Child Anthropometry in a Large Epidemiologic Study

Assessment of Child Anthropometry in a Large Epidemiologic Study

Published on: February 2, 2017

Area of Science:

Psychometrics
Statistical Modeling

Background:

Reliability in psychometrics is traditionally a single fixed value.
Previous research indicates reliability can vary across individuals and groups.
Existing methods lack the ability to estimate reliability for specific cases without additional measurements.

Purpose of the Study:

To propose a novel method for estimating and modeling case-specific reliability.
To develop a tool that accounts for varying reliability across different persons or groups.
To provide an alternative to traditional reliability estimation that does not require repeated measurements or parallel tests.

Main Methods:

Introduction of a "Reliability Factor" to model error variance for each case.
Utilizing Gaussian process modeling to estimate nonlinear relationships between latent factors and reliability.
Application within a classical test theory framework.

Main Results:

The proposed method generates case-specific reliability estimates.
Gaussian process modeling allows for estimation of complex, non-monotonic reliability functions.
The "Reliability Factor" effectively models individual error variances across indicators.

Conclusions:

The developed "Reliability Factor" model offers a new approach to understanding conditional reliability.
This method can identify latent regions with suboptimal reliability.
It provides a valuable tool for psychometric analysis within classical test theory.