Related Experiment Video
Updated: May 11, 2026

Functional Near-Infrared Spectroscopy Hyperscanning Study in Psychological Counseling
Published on: January 17, 2025
Validation of computer-administered clinical rating scale: Hamilton Depression Rating Scale assessment with
Hiroshi Kunugi1, Norie Koga, Miyako Hashikura
1Department of Mental Disorder Research, National Institute of Neuroscience, National Center of Neurology and Psychiatry, Tokyo, Japan.
Insights
The Interactive Voice Response (IVR) program shows high reliability and validity for assessing the Hamilton Rating Scale for Depression (HAM-D) total score in Japanese patients. However, it may overestimate depression severity, requiring further program refinement.
Area of Science:
- Psychiatry
- Medical Informatics
- Clinical Psychology
Background:
- The Hamilton Rating Scale for Depression (HAM-D) is a widely used clinical tool for assessing depression severity.
- Accurate and reliable assessment of depression is crucial for effective treatment and patient management.
- Interactive Voice Response (IVR) technology offers a potential method for remote and standardized data collection in clinical settings.
Purpose of the Study:
- To evaluate the reliability and validity of a Japanese Interactive Voice Response (IVR) program for administering the 17-item Hamilton Rating Scale for Depression (HAM-D).
- To assess the performance of the IVR program in comparison to clinician and psychologist ratings of depression severity.
Main Methods:
- Sixty Japanese depressive patients were assessed using the HAM-D by clinicians and psychologists.
- The IVR program administered the HAM-D on the same and subsequent days.
- Statistical analyses included intraclass correlation coefficient (ICC) for test-retest reliability, Cronbach's alpha for internal consistency, and Pearson's correlation coefficient for concurrent validity.
Main Results:
- The IVR program demonstrated high test-retest reliability (ICC: 0.93) and internal consistency (Cronbach's alpha: 0.83).
- Concurrent validity was high, with strong correlations between clinician and IVR ratings (0.81).
- The IVR program tended to overestimate depression severity compared to clinician ratings, and inter-rater agreement for individual items was fair (Cohen's kappa: 0.02-0.50).
Conclusions:
- The Japanese IVR HAM-D program is a reliable and valid tool for assessing the total HAM-D score in Japanese depressive patients.
- The program's tendency to overestimate depression severity and variable agreement on individual items suggest areas for improvement.
- Further refinement of the IVR program is recommended to enhance its accuracy and clinical utility.
Aim:
The aim of this study was to examine the reliability and validity of the Interactive Voice Response (IVR) program to rate the 17-item Hamilton Rating Scale for Depression (HAM-D) score in Japanese depressive patients.
Methods:
Depression severity was assessed in 60 patients by a clinician and psychologists using HAM-D. Scoring by the IVR program was conducted on the same and the following days. Test-retest reliability, internal consistency, and concurrent validity for total HAM-D scores were examined by calculating intraclass correlation coefficient, Cronbach's alpha, and Pearson's correlation coefficient. Inter-rater consistency for each HAM-D item was examined by Cohen's kappa.
Results:
Test-retest reliability of the IVR program was high (intraclass correlation coefficient: 0.93). Internal consistency of each total score obtained by the clinician, psychologists, and IVR program was high (Cronbach's alpha: 0.77, 0.79, 0.78, and 0.83). Regarding concurrent validity, correlation coefficients between total scores obtained by the clinician versus IVR and that by the clinician versus psychologists were high (0.81 and 0.93). The HAM-D total score rated by the clinician was 3 points lower than that of IVR. Inter-rater consistency for each HAM-D item evaluated by the clinician versus IVR was estimated to be fair (Cohen's kappa coefficient: 0.02-0.50).
Conclusion:
Our results suggest that the Japanese IVR HAM-D program is reliable and valid to assess 17-item HAM-D total score in Japanese depressive patients. However, the current program tends to overestimate depression severity, and the score of each item did not always show high agreement with clinician's rating, which warrants further improvement in the program.
Related Concept Videos
Depression: Overview
Depressive Disorders: MDD and Dysthymia
Rational Emotive Behavior Therapy