Effect of blueprinting methods on test difficulty, discrimination, and reliability indices: cross-sectional study in...

Area of Science:

• Medical Education
• Assessment Science

Background:

• Exam blueprinting is crucial for valid student assessment, defining measurement scope and competence levels.
• Traditional blueprinting often relies on exam duration and item timing.

Purpose of the Study:

• To evaluate a novel exam blueprinting method based on total course credit hours.
• To compare this new method's outcomes with traditional approaches using item analysis.

Main Methods:

• A new blueprint construction method using course credit hours was developed.
• Survey analysis involved two student groups (n=80): one using the credit hour method, the other the traditional method.
• Student performance data was analyzed using item analysis reports.

Main Results:

• No significant differences were observed between the groups regarding test difficulty, item discrimination, or reliability indices.
• Both blueprinting methods yielded comparable test validity and reliability measures.
• Item analysis of student achievements showed similar performance outcomes.

Conclusions:

• The credit hour-based blueprinting method is feasible and easy to implement.
• This novel approach offers a viable alternative for exam blueprint construction and application.
• The method supports the creation of valid and reliable assessments.