Holistic assessment of narrative quality: A social validation study

Area of Science:

• Psycholinguistics
• Clinical Psychology
• Speech-Language Pathology

Background:

• Social validation studies are common in adult clinical treatment but underexplored in narrative evaluation.
• This process involves comparing lay listener judgments of narrative quality with clinician-researcher assessments.
• Narrative quality ratings reflect premorbid skills and overall performance in clinical populations.

Purpose of the Study:

• To explore the social validity of clinical narrative assessment.
• To determine the extent to which clinicians' assessments align with lay audience judgments of narrative quality.
• To examine narrative characteristics across a spectrum of perceived quality.

Main Methods:

• Lay individuals (African American and Caucasian) holistically rated personal narratives from ethnicity-matched non-brain-injured narrators.
• Clinical raters also holistically assessed all narratives.
• Lay raters identified key dimensions of narrative quality and ranked their importance; high and low-rated narratives were compared on length, content, and structure.

Main Results:

• Significant agreement was found between lay and clinical raters for a subset of high- and low-rated narratives.
• Lay raters' characterizations of narrative quality aligned with established literary dimensions.
• High-quality narratives were longer, more conventionally structured, and differed in content from low-quality narratives.

Conclusions:

• Social validity in narrative assessment is supported at both holistic and dimensional levels for personal narratives.
• Findings enhance understanding of typical narrative performance.
• Holistic, qualitative measures complement quantitative analyses, promising more ecologically valid narrative assessments.