Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Measuring diagnostic agreement

J Langenbucher1, E Labouvie, J Morgenstern

  • 1Research Diagnostic Project, Rutgers-State University of New Jersey, Piscataway 08855-0969, USA.

Journal of Consulting and Clinical Psychology
|December 1, 1996
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Testing for Equivalence of Measurement Scales: Simple Structure and Metric Invariance Reconsidered.

Multivariate behavioral research·2016
Same author

Apples Aren't Oranges And Squares Aren't Rectangles, But...

Multivariate behavioral research·2016
Same author

Wholes or Parts?

Multivariate behavioral research·2016
Same author

Mesalazine granules are superior to Eudragit-L-coated mesalazine tablets for induction of remission in distal ulcerative colitis - a pooled analysis.

Alimentary pharmacology & therapeutics·2011
Same author

[The body as medium, space, symbol, and state: the cultural experience and self-perception of the pregnant body].

Historische Zeitschrift·2008
Same author

A low-cost, sustainable intervention for drinking reduction in the HIV primary care setting.

AIDS care·2006
Same journal

Effect of third-wave cognitive behavioral therapy in adults with acquired brain injury: A systematic review and meta-analysis of randomized controlled trials.

Journal of consulting and clinical psychology·2026
Same journal

Effectiveness of stepped counseling on depression in distressed family caregivers of older adults: A randomized pragmatic trial (ReDiCare).

Journal of consulting and clinical psychology·2026
Same journal

Dysfunctional attitudes in cognitive-behavioral therapy and antidepressant pharmacotherapy for adult depression: A systematic review and meta-analysis of individual participant data.

Journal of consulting and clinical psychology·2026
Same journal

Complete delivery matters: Multilevel complier average causal effect analysis of universal mental health curricula in two randomized controlled trials in U.K. schools.

Journal of consulting and clinical psychology·2026
Same journal

Investigating craving as an indicator of early response to buprenorphine treatment among adults with opioid use disorder.

Journal of consulting and clinical psychology·2026
Same journal

Mental health benchmarks in the United States: An unheeded call to action.

Journal of consulting and clinical psychology·2026
See all related articles

Measures of diagnostic agreement, like Yule's Y and Q, are sensitive to illness prevalence, potentially inflating reliability estimates. Kappa is recommended over Y and Q for accurate diagnostic concordance assessment.

Area of Science:

  • Psychometrics
  • Clinical Diagnostics
  • Mental Health Research

Background:

  • Diagnostic agreement metrics assess the reliability of classification systems.
  • New diagnostic criteria (DSM-IV, ICD-10) necessitate re-evaluating agreement measures.
  • Baserate independence of measures like Yule's Y and Q is questioned.

Purpose of the Study:

  • To investigate the impact of illness prevalence (baserates) on diagnostic agreement measures.
  • To compare the performance of Yule's Y, Q, kappa, and percent agreement under varying baserates.
  • To evaluate the assumption of fixed specificity in diagnostic agreement studies.

Main Methods:

  • Testing diagnostic concordance for drug dependence using DSM-III versus DSM-IV criteria.
  • Analyzing agreement across three distinct prevalence (baserate) conditions.

Related Experiment Videos

  • Comparing Yule's Y, Q, kappa, and percent agreement metrics.

    • Main Results:

    • Yule's Y and Q demonstrated vulnerability to baserate changes, similar to kappa and percent agreement.
    • Specificity was found to covary with baserate, contradicting theoretical assumptions.
    • Uncritical use of Y and Q may lead to overly optimistic agreement interpretations.

    Conclusions:

    • Yule's Y and Q exhibit significant baserate dependency, similar to other agreement measures.
    • The assumption of fixed specificity is not supported in diagnostic agreement studies.
    • Kappa is generally preferred for diagnostic agreement; adjustments for Y and Q can mitigate bias.