Assessing students' research reports: development of a rating scale

Area of Science:

• Educational Assessment
• Scientific Writing Evaluation

Background:

• Lack of standardized criteria for assessing student research reports leads to inconsistent teacher evaluations.
• Implicit, idiosyncratic criteria used by educators hinder reliable and valid assessment.
• A defined set of criteria is needed to improve the quality of student research report evaluation.

Purpose of the Study:

• To identify strengths and weaknesses in student research reports.
• To develop a validated assessment tool for student research papers.

Main Methods:

• A 19-item rating scale (15 specific, 4 global criteria) was developed based on literature and expert input.
• Three independent raters scored 18 student research reports using the developed scale.
• Inter-rater reliability was assessed to determine the scale's consistency.

Main Results:

• Strengths identified: structure of results, description of materials and methods.
• Weaknesses identified: research questions, literature grounding, analysis, statistics, and clarity of visuals.
• The rating scale demonstrated reasonable inter-rater reliability.

Conclusions:

• The developed rating scale is a potentially useful tool for evaluating and providing feedback on student research reports.
• Further validation with larger sample sizes is recommended to confirm findings.