Related Experiment Video
Updated: Dec 17, 2025

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
Assisting students' writing with computer-based concept map feedback: A validation study of the CohViz feedback
Christian Burkhart1, Andreas Lachner2, Matthias Nückles1
1Department of Educational Science, University of Freiburg, Freiburg, Germany.
CohViz, a writing feedback system, shows high accuracy in identifying cohesion gaps in student writing. While it sometimes overestimates relations, its reliability and validity are confirmed for improving writing cohesion.
Area of Science:
- Educational Technology
- Natural Language Processing
- Writing Analytics
Background:
- Previous research established the effectiveness of CohViz, a feedback system using concept maps to assess writing cohesion.
- However, the precise accuracy of CohViz's feedback, specifically its reliability and validity, required further investigation.
Purpose of the Study:
- To comprehensively validate the accuracy of the CohViz feedback system.
- To assess CohViz's reliability by comparing its concept maps to those generated by human experts.
- To evaluate CohViz's validity by correlating its concept maps with linguistic features of cohesion.
Main Methods:
- Reliability Study: Compared CohViz-generated concept maps with human expert ratings on 100 student explanatory texts.
- Validity Study: Analyzed CohViz concept maps against convergent and divergent linguistic features using 1020 Wikipedia texts.
Main Results:
- High accordance was found between CohViz and human raters for depicting cohesion gaps.
- CohViz tended to overestimate the number of relations in concept maps.
- Medium to high agreement was observed with convergent cohesion features, but low agreement with divergent features.
Conclusions:
- CohViz demonstrates significant accuracy as a feedback system for evaluating writing cohesion.
- The system reliably identifies cohesion gaps, though relation counts may be overestimated.
- Findings support CohViz's utility in providing constructive feedback on student writing cohesion.
Related Concept Videos
Feedback Loops
Feedback control systems
Linear feedback systems are theoretical models that simplify analysis and design. These systems operate under the principle that their output is directly proportional to their input within certain ranges. For instance, an amplifier in a control system behaves linearly as long as the input signal remains within a specific range. However, most physical systems exhibit inherent nonlinearity...
Self-Evaluation Maintenance Model
Feedback Inhibition
Self-Evaluation: Self-Enhancement and Self-Verification
Effects of feedback
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...

