Quantifying clinical judgment in the assessment of adolescent psychopathology: Reliability, validity, and factor...

The aim of this study was to assess the reliability and validity of the Child Behavior Checklist (CBCL) as completed by doctoral-level clinicians in the treatment of adolescents. We asked 294 randomly selected, experienced psychiatrists and psychologists to describe a patient aged 14 to 18 in treatment for personality pathology. Clinicians completed the CBCL (parent-report version) and measures of adaptive functioning, personality pathology, and family and developmental history, which served as criterion variables to test the validity of the CBCL as completed by clinicians. Most CBCL scales demonstrated acceptable reliability. Validity estimates were impressive, and the data revealed clinically meaningful associations between specific CBCL scale scores and developmental and family history variables. Confirmatory factor analysis showed that the factorial structure of the clinician-report CBCL resembled that of the parent-report CBCL, with the exception of a substantially lower correlation between higher order internalizing and externalizing factors. The data suggest that clinical judgment can be both reliable and valid when quantified using psychometrically sound instruments.