Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.4K
Theory of Attribution II: Kelley's Covariation Theory01:29

Theory of Attribution II: Kelley's Covariation Theory

887
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus:...
887
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

561
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
561
The Anchoring-and-Adjustment Heuristic01:25

The Anchoring-and-Adjustment Heuristic

7.9K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.9K
Self-Evaluation: Self-Enhancement and Self-Verification03:00

Self-Evaluation: Self-Enhancement and Self-Verification

5.9K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.9K
Random and Systematic Errors01:20

Random and Systematic Errors

16.0K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
16.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Comparative Validity Of MMPI-168 Factors And Clinical Scales.

Multivariate behavioral research·2016
Same author

Protective effects of Orostachys japonicus A. Berger (Crassulaceae) on H2O2-induced apoptosis in GT1-1 mouse hypothalamic neuronal cell line.

Journal of ethnopharmacology·2000
Same author

Reliability and validity of the interview and self-report versions of the BASIS-32.

Psychiatric services (Washington, D.C.)·1998
Same author

Predicting length of stay in an acute psychiatric hospital.

Psychiatric services (Washington, D.C.)·1998
Same author

An outcome study of Missouri's CSTAR alcohol and drug abuse programs.

Journal of substance abuse treatment·1998
Same author

Missouri's statewide outcomes study: lessons and surprises from the public sector.

Behavioral healthcare tomorrow·1997
Same journal

Bayesian Machine Learning Tools for Alcohol Use Disorder Research: The bpaup R Package.

Multivariate behavioral research·2026
Same journal

A Unified Framework for Jointly modelling Response Times and Item Position Effects in Computer-Based Learning Assessments.

Multivariate behavioral research·2026
Same journal

Generalizability Theory Applied to Daily Relationship Quality: Substantive and Statistical Directions.

Multivariate behavioral research·2026
Same journal

A Modularized Higher-Order Diagnostic Classification Model for Clustered Attribute Hierarchies.

Multivariate behavioral research·2026
Same journal

Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population.

Multivariate behavioral research·2026
Same journal

betaselectr: Selective (and Proper) Standardization in Structural Equation Models.

Multivariate behavioral research·2026
See all related articles

Related Experiment Video

Updated: Mar 26, 2026

Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure
07:56

Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure

Published on: September 19, 2019

11.0K

Using Internal Inconsistency To Identify Unreliable Ratings.

J L Hedlund, J B Wood, D W Cho

    Multivariate Behavioral Research
    |January 28, 2016
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces an internal inconsistency scale to detect unreliable clinical ratings. This scale helps improve the accuracy of assessments by identifying inconsistent responses from raters.

    More Related Videos

    Holistic Facial Composite Creation and Subsequent Video Line-up Eyewitness Identification Paradigm
    09:49

    Holistic Facial Composite Creation and Subsequent Video Line-up Eyewitness Identification Paradigm

    Published on: December 24, 2015

    14.7K
    The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs
    08:59

    The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

    Published on: October 13, 2017

    18.4K

    Related Experiment Videos

    Last Updated: Mar 26, 2026

    Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure
    07:56

    Assessing the Coherence of Parents' Short Narratives Regarding their Child Using the Five-Minute Speech Sample Procedure

    Published on: September 19, 2019

    11.0K
    Holistic Facial Composite Creation and Subsequent Video Line-up Eyewitness Identification Paradigm
    09:49

    Holistic Facial Composite Creation and Subsequent Video Line-up Eyewitness Identification Paradigm

    Published on: December 24, 2015

    14.7K
    The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs
    08:59

    The Other End of the Leash: An Experimental Test to Analyze How Owners Interact with Their Pet Dogs

    Published on: October 13, 2017

    18.4K

    Area of Science:

    • Psychometrics
    • Clinical Psychology
    • Behavioral Assessment

    Background:

    • Clinical ratings are crucial for patient assessment but can be subject to unreliability.
    • Identifying and mitigating unreliable ratings is essential for accurate diagnosis and treatment planning.
    • Existing methods may not sufficiently address rater-induced inconsistencies in behavioral scales.

    Purpose of the Study:

    • To develop and validate an internal inconsistency scale for identifying unreliable clinical ratings.
    • To differentiate between rater inconsistencies and patient-related inconsistencies.
    • To enhance the reliability of factor scores by removing unreliable ratings.

    Main Methods:

    • Development of an internal inconsistency scale using logically inconsistent item pairs.
    • Combination of rational and statistical procedures for item selection and scoring.
    • Testing the scale's ability to measure rater inconsistencies and its impact on factor score reliabilities.

    Main Results:

    • The scale effectively measures rater inconsistencies, not patient inconsistencies.
    • Eliminating unreliable ratings based on inconsistency scores improves factor score reliabilities.
    • Systematic increase in inconsistency scores with an increased number of items for random assignment.

    Conclusions:

    • The developed internal inconsistency scale is a valuable tool for identifying unreliable clinical ratings.
    • The methodology is adaptable for use with other rating scales beyond the Missouri Inpatient Behavior Scale (MIBS).
    • Improving rater consistency enhances the overall reliability and validity of clinical assessments.