Related Experiment Videos
Inter-rater reliability of a refined index of melancholia: the CORE system
D Hadzi-Pavlovic1, I Hickie, H Brodaty
1School of Psychiatry, University of New South Wales, Little Bay, Sydney, Australia.
Abstract:
We report an inter-rater reliability study of the modified 18-item, sign-based CORE index of melancholia, undertaken on 205 ratings of 35 patients by five clinical research psychiatrists. Inter-rater agreement about the presence or absence of individual items was slight to moderate when examined by the kappa coefficient, but moderate to high when examined by the intraclass correlation statistic. For total CORE scores, perhaps the most important application of the index of melancholia, high levels of intraclass correlation coefficients (ranging 0.79 to 0.90 across the varying rater dyads) were established. When a single cut-off score (of 7/8) was used to allocate patients to either a 'melancholic' or 'non-melancholic' class, only moderate agreement was established between raters in such 'class' assignments--a limitation which can be redressed by imposing a 'probable/possible melancholia' band of scores.
Insights
This study assessed the reliability of the CORE index for melancholia. While individual item agreement varied, total scores showed high reliability, suggesting its utility for diagnosing melancholic depression.
Area of Science:
- Psychiatry
- Clinical Psychology
- Mental Health Assessment
Background:
- Melancholic depression is a severe subtype of depression.
- Accurate assessment tools are crucial for diagnosis and treatment.
- The CORE index is a sign-based tool for evaluating melancholia.
Purpose of the Study:
- To evaluate the inter-rater reliability of the modified 18-item CORE index of melancholia.
- To assess the consistency of ratings among clinical research psychiatrists.
Main Methods:
- A study involving 205 ratings of 35 patients by five psychiatrists.
- Utilized kappa coefficient and intraclass correlation statistic for reliability analysis.
- Examined agreement on individual items and total CORE scores.
Main Results:
- Slight to moderate agreement for individual items using kappa coefficient.
- Moderate to high agreement for individual items using intraclass correlation.
- High intraclass correlation coefficients (0.79-0.90) for total CORE scores.
Conclusions:
- The CORE index demonstrates high reliability for total scores in assessing melancholia.
- Moderate agreement for dichotomous classification (melancholic/non-melancholic) suggests refinement.
- A 'probable/possible melancholia' score band may improve classification accuracy.