Related Experiment Video
Updated: Jun 12, 2026

Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
Examining the reliability and validity of clinician ratings on the Five-Factor Model Score Sheet
Lauren R Few1, Joshua D Miller, Jennifer Q Morse
1University of Georgia, Athens, GA 30602-3013, USA.
Abstract:
Despite substantial research use, measures of the five-factor model (FFM) are infrequently used in clinical settings due, in part, to issues related to administration time and a reluctance to use self-report instruments. The current study examines the reliability and validity of the Five-Factor Model Score Sheet (FFMSS), which is a 30-item clinician rating form designed to assess the five domains and 30 facets of one conceptualization of the FFM. Studied in a sample of 130 outpatients, clinical raters demonstrated reasonably good interrater reliability across personality profiles and the domains manifested good internal consistency with the exception of Neuroticism. The FFMSS ratings also evinced expected relations with self-reported personality traits (e.g., FFMSS Extraversion and Schedule for Nonadaptive and Adaptive Personality Positive Temperament) and consensus-rated personality disorder symptoms (e.g., FFMSS Agreeableness and Narcissistic Personality Disorder). Finally, on average, the FFMSS domains were able to account for approximately 50% of the variance in domains of functioning (e.g., occupational, parental) and were even able to account for variance after controlling for Axis I and Axis II pathology. Given these findings, it is believed that the FFMSS holds promise for clinical use.
Insights
The Five-Factor Model Score Sheet (FFMSS) shows promise for clinical use, offering a reliable clinician-rated measure of personality. It demonstrates good validity and accounts for significant variance in functioning, even after controlling for other pathologies.
Area of Science:
- Psychology
- Clinical Psychology
- Personality Assessment
Background:
- The Five-Factor Model (FFM) is widely used in research but less so in clinical settings due to time constraints and preference against self-report.
- Existing FFM measures face challenges in clinical application, necessitating alternative assessment tools.
Purpose of the Study:
- To examine the reliability and validity of the Five-Factor Model Score Sheet (FFMSS), a clinician-rated instrument.
- To assess the FFMSS's utility in clinical settings for personality assessment.
Main Methods:
- The FFMSS, a 30-item clinician rating form, was administered to 130 outpatients.
- Interrater reliability, internal consistency, and convergent/discriminant validity were assessed.
- The FFMSS's ability to predict functioning and its incremental validity over psychopathology were evaluated.
Main Results:
- Clinical raters showed good interrater reliability for the FFMSS across personality profiles.
- Internal consistency was good for most FFM domains, with Neuroticism being an exception.
- FFMSS ratings correlated as expected with self-reported traits and personality disorder symptoms.
- FFMSS domains explained approximately 50% of the variance in functioning, independent of Axis I and II pathology.
Conclusions:
- The FFMSS is a reliable and valid clinician-rated measure of the FFM.
- The FFMSS demonstrates potential for practical clinical application in personality assessment.
- The FFMSS offers valuable insights into functioning beyond diagnosed psychopathology.
Related Concept Videos
Five-Factor Theory of Personality
Openness reflects creativity, curiosity, and openness to new experiences. Individuals scoring high in openness are imaginative, have a wide range of interests, and are independent thinkers. Low...
Self-Report Tests of Personality
Reliability and Validity
Cattell's 16 Personality Factors
In contrast, source traits are the fundamental,...
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Self-Evaluation Maintenance Model
