Related Experiment Video
Updated: Oct 11, 2025

Methodology for Establishing a Community-Wide Life Laboratory for Capturing Unobtrusive and Continuous Remote Activity and Health Data
Published on: July 27, 2018
Evaluation of an Online System for Routine Outcome Monitoring: Cross-sectional Survey Study
Deanna E Wiebe1, Shannon Remers2, Pria Nippak1
1Department of Health Services Management, Ryerson University, Toronto, ON, Canada.
Background:
The use of routine outcome monitoring (ROM) in the treatment of mental health has emerged as a method of improving psychotherapy treatment outcomes. Despite this, very few clinicians regularly use ROM in clinical practice. Online ROM has been suggested as a solution to increase adoption.
Objective:
The aim of this study is to identify the influence of moving ROM online on client completion rates of self-reported outcome measures and to identify implementation and utilization barriers to online ROM by assessing clinicians' views on their experience using the online system over previous paper-based methods.
Methods:
Client completion rates of self-reported outcome measures were compared pre- and postimplementation of an online system of ROM. In addition, a survey questionnaire was administered to 324 mental health service providers regarding their perception of the benefits with an online system of ROM.
Results:
Client completion rates of self-reported measures increased from 15.62% (427/2734) to 53.98% (1267/2347) after they were moved online. Furthermore, 57% (56/98) of service providers found the new system less time-consuming than the previous paper-based ROM, and 64% (63/98) found that it helped monitor clients. However, the perceived value of the system remains in doubt as only 23% (23/98) found it helped them identify clients at risk for treatment failure, and only 18% (18/98) found it strengthened the therapeutic alliance.
Conclusions:
Although the current study suggests mixed results regarding service providers' views on their experience using an online system for ROM, it has identified barriers and challenges that are actionable for improvement.
Related Concept Videos
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
Nursing Evaluation
Pulse rhythm
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac...
Surveys
Data Collection by Observations
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
Data Collection by Survey

