Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Assessing inter-rater reliability for rating scales: resolving some basic issues.

D V Cicchetti

    The British Journal of Psychiatry : the Journal of Mental Science
    |November 1, 1976
    PubMed
    Summary
    This summary is machine-generated.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    Worsening of quality of life after epilepsy surgery: effect of seizures and memory decline.

    Neurology·2007
    Same author

    Referral of terminally ill patients for hospice: frequency and correlates.

    Journal of palliative care·2002
    Same author

    The precision of reliability and validity estimates re-visited: distinguishing between clinical and statistical significance of sample size requirements.

    Journal of clinical and experimental neuropsychology·2002
    Same author

    The comprehensive assessment of defense style: measuring defense mechanisms in children and adolescents.

    The Journal of nervous and mental disease·2001
    Same author

    Validation of the Comprehensive Assessment of Defense Style (CADS): mothers' and children's responses to the stresses of missile attacks.

    The Journal of nervous and mental disease·2001
    Same author

    Assessment of reliability in the clinical evaluation of depressive symptoms among multiple investigators in a multicenter clinical trial.

    Psychiatry research·2001
    Same journal

    The pressurised leaky funnel: rethinking recruitment, selection and retention in the UK psychiatry workforce.

    The British journal of psychiatry : the journal of mental science·2026
    Same journal

    Cutting through stigma: psychiatry and neurosurgery working together.

    The British journal of psychiatry : the journal of mental science·2026
    Same journal

    A fourth pillar for evidence-based medicine: implications for psychiatry - CORRIGENDUM.

    The British journal of psychiatry : the journal of mental science·2026
    Same journal

    Understanding negative perceptions of psychiatrists on social media: lessons from public discourse and professional self-reflection.

    The British journal of psychiatry : the journal of mental science·2026
    Same journal

    Attachment-informed psychopharmacology in psychiatric care.

    The British journal of psychiatry : the journal of mental science·2026
    Same journal

    Acceptability and accuracy of point-of-care monitoring of lithium levels.

    The British journal of psychiatry : the journal of mental science·2026
    See all related articles

    This study determines the minimum sample sizes and specific weights needed for reliable assessment of clinical rating scales. These factors depend on scale structure, including the presence of an

    Area of Science:

    • Psychometrics
    • Clinical assessment
    • Reliability analysis

    Background:

    • Assessing the reliability of rating scales is crucial in neuropsychiatry and clinical medicine.
    • Existing methods may not fully account for the nuances of different scale structures.
    • Hall (1974) provided foundational work in this area.

    Purpose of the Study:

    • To extend Hall's (1974) work by defining minimal sample sizes for reliable rating scales.
    • To present specific linear agreement weights for reliability assessment.
    • To investigate how scale characteristics influence required weights.

    Main Methods:

    • Statistical analysis extending Hall's (1974) framework.
    • Calculation of minimal sample sizes.
    • Derivation of linear agreement weights based on scale properties.

    Related Experiment Videos

    Main Results:

    • Identified minimal sample sizes for reliable clinical rating scales.
    • Developed specific linear agreement weights.
    • Demonstrated that weights vary based on the presence of an 'absence' point and the number of ordinal scale points.

    Conclusions:

    • Provides practical guidelines for sample size and weight selection in clinical reliability studies.
    • Highlights the importance of scale structure in determining reliability assessment parameters.
    • Enhances the rigor of reliability analysis for neuropsychiatric and medical rating scales.