Content validation guidelines: Evaluation criteria for definitional correspondence and definitional distinctiveness.

Area of Science:

• Industrial/Organizational Psychology
• Organizational Behavior
• Psychometric Scale Development

Background:

• Scales in organizational research often fail to adequately reflect their intended constructs.
• A potential cause is the underemphasis on content validation compared to other psychometric properties.

Purpose of the Study:

• To provide clear evaluation criteria for two common content validation approaches: Anderson and Gerbing (1991) and Hinkin and Tracey (1999).
• To establish guidelines for assessing definitional correspondence and distinctiveness in scale construction.

Main Methods:

• Reviewed 112 new scales published in top management and psychology journals from 2010-2016.
• Applied Anderson and Gerbing's (1991) and Hinkin and Tracey's (1999) content validation approaches.
• Utilized data from 6,240 participants recruited via Amazon's Mechanical Turk with transparent instructions.

Main Results:

• Developed evaluation criteria for definitional correspondence, assessing item-definition alignment.
• Established criteria for definitional distinctiveness, evaluating item alignment with the target construct over other constructs.
• Provided a framework applicable to both Anderson and Gerbing (1991) and Hinkin and Tracey (1999) methods.

Conclusions:

• The study offers practical guidelines for enhancing the content validity of organizational scales.
• Improved content validation practices can lead to more accurate and meaningful measurement in organizational research.
• The proposed criteria support the development of more robust and reliable measurement instruments.