Related Experiment Video
Updated: May 10, 2025

Breakfast Habits among Schoolchildren in the City of Uruguaiana, Brazil
Published on: July 29, 2020
A benchmark dataset of narrative student essays with multi-competency grades for automatic essay scoring in Brazilian
Hilário Oliveira1, Rafael Ferreira Mello2,3, Péricles Miranda2
1Federal Institute of Education Science and Technology of Espírito Santo, Serra, Espírito Santo, Brazil.
Abstract:
This paper describes the development of a new database comprising 1235 narrative essays written in Portuguese by 5th-grade students in Brazil. The corpus construction process involved three main steps: acquiring and transcribing photos of the essays, annotating them based on a real pre-defined correction rubric by experts considering four key writing competencies (formal language use, textual typology, thematic coherence, and textual cohesion), and resolving disagreements between the annotators. Two human experts manually evaluated each essay using a five-point scale (Level I: Complete lack of domain - Level V: Excellent mastery) aligned with the correction rubric. In cases of disagreement between the initial evaluators, a third expert facilitated the divergences resolution. To the best of our knowledge, this is the first publicly available dataset of elementary school essays in Brazilian Portuguese that features narrative writing samples with corresponding grades across multiple competencies commonly used in writing assessment. We believe this resource can contribute to developing automatic essay scoring systems tailored for evaluating narrative texts written in Brazilian Portuguese.
Related Concept Videos
Reliability and Validity
Guidelines for Writing Outcome
Patient outcomes reflect the patient's response to the goal rather than what the nurse aims to achieve. Terminology should be observable and measurable to avoid the reader's interpretation. The desired outcome should be realistic and achievable in the designated care timeframe. Expected outcomes should align with adjunctive therapies. The outcome should enhance care...
Self-Report Tests of Personality
Comparing Experimental Results: Student's t-Test
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Quantifying and Rejecting Outliers: The Grubbs Test

