Misspecification of Attribute Structure in Diagnostic Measurement

Area of Science:

• Psychometrics
• Educational Measurement
• Data Science

Background:

• Attribute structure defines relationships between attributes in diagnostic measurement.
• Accurate specification of attribute structures is crucial for reliable psychometric modeling and classification accuracy.
• Existing research lacks a comprehensive framework for understanding attribute structure misspecifications.

Purpose of the Study:

• To propose a conceptual framework for understanding attribute structure misspecifications.
• To investigate the impact of external shape and internal organization misspecifications on diagnostic assessments.
• To provide guidance for developing better diagnostic assessments and informing construct theories.

Main Methods:

• Developed a conceptual framework representing attribute structures by external shape and internal organization.
• Conducted a simulation study to evaluate the effects of misspecifications.
• Applied the framework and simulation findings to a real-world example.

Main Results:

• Misspecifications in attribute structure's external shape and internal organization significantly affect model fit, item fit, and respondent classification.
• The proposed framework effectively identifies and categorizes different types of attribute structure misspecifications.
• Simulation results demonstrate the practical implications of misspecified structures on assessment outcomes.

Conclusions:

• The conceptual framework provides a valuable tool for diagnosing and addressing attribute structure misspecifications in diagnostic assessments.
• Accurate attribute structure specification is essential for valid and reliable measurement.
• This research supports the development of more precise diagnostic tools and enhances construct-related theories.