Developing examinations that use equal raw scores for cut scores.

Area of Science:

• Educational Measurement and Psychometrics
• Assessment Development and Equating

Background:

• Traditional equating methods, such as Rasch-based approaches, typically equate test forms in the logit metric.
• This can lead to variations in raw score cut scores across different test forms, potentially affecting the consistency of passing standards.
• There is a need for methods that ensure equivalence in the raw score metric for practical application in examinations.

Purpose of the Study:

• To describe and demonstrate processes for developing new examination forms with equivalent raw score cut scores.
• To provide an alternative to traditional equating methods by focusing on raw score metric equivalence.
• To offer guidelines and examples for creating multiple assessment forms with consistent passing standards.

Main Methods:

• Development of novel processes for examination form creation.
• Focus on achieving equivalent cut scores in the raw score metric, not just the logit metric.
• Utilizing pre-equating procedures and three specific guidelines within an iterative form-development framework.
• Demonstration with simulated data sets.

Main Results:

• Successful demonstration of processes for developing examination forms with equivalent raw score cut scores.
• The proposed methods allow for the creation of multiple test forms where the number correct required to pass is consistent.
• This ensures that each form represents the same level of the underlying construct.

Conclusions:

• The described processes offer a viable alternative to traditional equating, enabling the development of assessments with consistent raw score passing standards.
• These methods enhance the fairness and interpretability of examination results across different forms.
• The study provides practical guidance for assessment developers aiming for raw score equivalence.