Ensuring content validity: an illustration of the process

Area of Science:

• Psychometrics
• Instrument Development
• Mental Health Assessment

Background:

• Content validity is a critical component of psychometric instrument development.
• Sophisticated statistical methods cannot replace robust validity assessment.
• Systematic approaches are necessary for evaluating content validity.

Purpose of the Study:

• To outline and illustrate systematic procedures for assessing content validity.
• To demonstrate the application of these procedures using the Postpartum Depression Screening Scale (PDSS).
• To emphasize the importance of content validity in the development of measurement tools.

Main Methods:

• Described a priori content domain specification.
• Detailed a posteriori item validation using a panel of content experts.
• Utilized a focus group of knowledgeable nurses for scale review.
• Applied these methods to the Postpartum Depression Screening Scale (PDSS).

Main Results:

• The Postpartum Depression Screening Scale (PDSS) comprises seven dimensions: Sleeping/Eating Disturbances, Anxiety/Insecurity, Emotional Lability, Cognitive Impairment, Loss of Self, Guilt/Shame, and Contemplating Harming Oneself.
• Content validity was assessed through expert review and a nurse focus group.
• Qualitative research informed the generation of PDSS items.

Conclusions:

• Systematic assessment of content validity, combining expert judgment and user feedback, is essential for robust instrument development.
• The described methods provide a framework for ensuring the content validity of scales like the PDSS.
• Ensuring content validity is foundational for the accurate measurement of complex conditions such as postpartum depression.