Related Experiment Video
Updated: May 30, 2026
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
Published on: September 27, 2020
A comparison of seminar and computer based training on the accuracy and reliability of raters using the Children's
Anna Lundh1, Jan Kowalski, Carl Johan Sundberg
1Section of Psychiatry, Department of Clinical Neuroscience, Karolinska Institutet, BUP-divisionen, PO Box 17564, SE-11891, Stockholm, Sweden. anna.lundh@sll.se
Abstract:
The aim of this study was to compare two methods to conduct CGAS rater training. A total of 648 raters were randomized to training (CD or seminar), and rated five cases before and 12 months after training. The ICC at baseline/end of study was 0.71/0.78 (seminar), 0.76/0.78 (CD), and 0.67/0.79 (comparison). There were no differences in training effect in terms of agreement with expert ratings, which speaks in favor of using the less resource-demanding CD. However, the effect was modest in both groups, and untrained comparison group improved of the same order of magnitude, which proposes more extensive training.
