Identifying the unauthorized use of examination material.

Area of Science:

• Educational Measurement
• Psychometrics
• Examination Security

Background:

• Item disclosure poses a significant threat to the validity of high-stakes examinations.
• Ensuring examination integrity requires identifying candidates with unauthorized access to content.

Purpose of the Study:

• To develop and validate a procedure for identifying examinees who may have had prior unauthorized access to examination materials.
• To enhance the security and fairness of standardized testing environments.

Main Methods:

• A standardized difference score was developed by comparing examinee ability estimates for potentially exposed items versus unexposed items.
• Outliers in the distribution of difference scores were flagged for further review.
• The procedure's efficacy was supported by simulation modeling unauthorized access scenarios.

Main Results:

• The developed procedure effectively identifies potential instances of unauthorized prior access to examination content.
• Simulation results confirm the procedure's utility in detecting breaches of examination security.
• The method provides a quantifiable approach to flagging suspicious examinee performance patterns.

Conclusions:

• The proposed procedure offers a reliable method for detecting potential item disclosure in high-stakes exams.
• Implementing this procedure can significantly bolster the integrity and validity of examination processes.
• This approach aids in maintaining a fair and secure testing environment for all candidates.