Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

12.9K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.9K
Beck's Cognitive Therapy01:25

Beck's Cognitive Therapy

101
Cognitive therapy is a psychological approach designed to address distortions in thinking, which can lead to negative emotions and unrealistic beliefs. These cognitive distortions often influence how individuals interpret and respond to situations, exacerbating emotional distress. Below are some prevalent cognitive distortions, their characteristics, and examples of how they manifest in thought processes.
Arbitrary Inference
Arbitrary inference involves making conclusions without sufficient...
101
Modeling in Therapy01:26

Modeling in Therapy

139
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in...
139
Accuracy and Errors in Hypothesis Testing01:13

Accuracy and Errors in Hypothesis Testing

271
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
271

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A cognitive diagnosis model for latent classification of bounded continuous variables.

The British journal of mathematical and statistical psychology·2026
Same author

Evaluating the Performance of R-Squared Measures in Multilevel Models.

Multivariate behavioral research·2026
Same author

Dimensionality Assessment in Forced-Choice Questionnaires: First Steps Toward an Exploratory Framework.

Educational and psychological measurement·2025
Same author

A Systematic Evaluation of Wording Effects Modeling Under the Exploratory Structural Equation Modeling Framework.

Multivariate behavioral research·2025
Same author

Development and validation of the AIDA scale: Anxiety in people with autism and intellectual disability assessment.

Journal of intellectual & developmental disability·2025
Same author

A general diagnostic modelling framework for forced-choice assessments.

The British journal of mathematical and statistical psychology·2025
Same journal

Exploring psychological tradeoffs: Developing and demonstrating an R Shiny app for Pareto optimization.

Behavior research methods·2026
Same journal

The performance of Bayesian fit measures in detecting misspecified multilevel structural equation modeling.

Behavior research methods·2026
Same journal

Psychometric functions from multiple responses : Dedicated to the memory of Colin L. Mallows.

Behavior research methods·2026
Same journal

Low-cost, open-source, full-stack software and Arduino-based hardware for control of commercially available animal behavior systems.

Behavior research methods·2026
Same journal

PyNeon: A Python package for the analysis of Neon multimodal mobile eye-tracking data.

Behavior research methods·2026
Same journal

Talking surveys: How photorealistic embodied conversational agents shape response quality, engagement, and satisfaction.

Behavior research methods·2026
See all related articles

Related Experiment Video

Updated: Aug 28, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K

Improving reliability estimation in cognitive diagnosis modeling.

Rodrigo Schames Kreitchmann1,2, Jimmy de la Torre3, Miguel A Sorrel4

  • 1Department of Social Psychology and Methodology, Faculty of Psychology, Universidad Autónoma de Madrid, Calle Iván Pavlov, 6, Ciudad Universitaria de Cantoblanco, 28049, Madrid, Spain. rschames@faculty.ie.edu.

Behavior Research Methods
|September 20, 2022
PubMed
Summary
This summary is machine-generated.

This study introduces a multiple imputation (MI) procedure to improve reliability estimation in cognitive diagnosis models (CDMs). The MI method offers more accurate results than traditional approaches, which tend to overestimate reliability, especially in smaller settings.

Keywords:
Classification accuracyCognitive diagnosisDiagnostic classificationMultiple imputationReliability

More Related Videos

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

7.2K
Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

15.8K

Related Experiment Videos

Last Updated: Aug 28, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.6K
Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
07:31

Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack

Published on: May 15, 2020

7.2K
Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

15.8K

Area of Science:

  • Educational Measurement
  • Psychometrics
  • Data Science

Background:

  • Cognitive diagnosis models (CDMs) are vital for classifying respondents and identifying educational or clinical needs.
  • Accurate reliability estimation is essential for valid interpretations of CDM scores.
  • Traditional reliability indices often rely on parameter point estimates, potentially leading to overestimated reliabilities due to unaddressed parameter uncertainty.

Purpose of the Study:

  • To introduce and evaluate a multiple imputation (MI) procedure for correcting reliability estimation in cognitive diagnosis models (CDMs).
  • To compare the accuracy of the MI procedure against traditional reliability estimation methods.

Main Methods:

  • A multiple imputation (MI) procedure was developed to integrate out model parameters in estimating posterior distributions.
  • A simulation study manipulated attribute structure, CDM model (DINA, G-DINA), test length, sample size, and item quality.
  • An empirical analysis was conducted using the Examination for the Certificate of Proficiency in English data, with varying sample sizes.

Main Results:

  • The traditional reliability estimation systematically overestimated reliabilities in both simulation and empirical studies.
  • The MI procedure provided more accurate reliability estimates compared to the traditional method.
  • The positive bias in reliability estimation using point estimates was particularly noted in smaller educational or clinical settings.

Conclusions:

  • The proposed multiple imputation (MI) procedure offers a more accurate approach to reliability estimation in cognitive diagnosis models (CDMs).
  • Practitioners in smaller settings should be cautious of potential positive bias in reliability estimates derived from model parameter point estimates.
  • The study provides R code for the MI procedure, facilitating its adoption in practice.