Related Experiment Video
Updated: May 10, 2026

Development of a Virtual Reality Assessment of Everyday Living Skills
Published on: April 23, 2014
A pilot study to determine the validity and reliability of the Level of Reflection-on-Action Assessment
1The Richard Stockton College of New Jersey, Galloway, NJ 08205-9441, USA. mary.padden@stockton.edu
Abstract:
The purpose of this study was to determine the reliability of the Level of Reflection-on-Action Assessment (LORAA). The LORAA is an instrument developed to identify the level of reflection achieved by students on their reflective journal entries and includes prompts for the educator to guide students to higher levels of reflection. The LORAA was developed based on a literature review and was content validated by a panel of three experts in reflective learning. Interrater reliability was achieved when pilot tested using five sample student journal entries rated at 0.67 by three independent raters on four entries and at 0.80 with two raters on all five entries. On further testing using a larger sample of 18 student journal entries, interrater reliability was achieved at 0.94 with two raters. The results suggest that the LORAA can be used to determine the level of reflection achieved by students on reflective journal entries.
Related Concept Videos
Self-Awareness and Its Effects
Introspection
Metacognition
Self-Evaluation Maintenance Model
Reliability and Validity
