Evaluation of Revision Effect on Criterion Validity of Multiple-Component Measuring Instruments

Area of Science:

• Psychometrics
• Behavioral Research Methodology

Background:

• Assessing the criterion validity of multi-component instruments is crucial.
• Revisions to measurement instruments can impact their validity.
• Existing methods for assessing changes in reliability are limited.

Purpose of the Study:

• To outline a method for estimating changes in criterion validity of revised multiple-component instruments.
• To provide a framework for evaluating instrument revisions in behavioral research.

Main Methods:

• Development of a procedure within covariance structure modeling.
• Complements existing methods for composite reliability testing.
• Utilizes numerical examples for illustration.

Main Results:

• A method for point and interval estimation of criterion validity change is presented.
• The approach is applicable to revised multiple-component instruments.
• Demonstrates utility in behavioral research contexts.

Conclusions:

• The proposed method enhances the process of constructing valid instruments.
• Covariance structure modeling offers a robust framework for evaluating instrument revisions.
• Facilitates improved measurement accuracy in behavioral science.