Related Experiment Video
Updated: Aug 11, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models
Published on: December 23, 2025
Reliability of the instrument DOA: dialogue about ability related to work
1Arbetslivstjänster, Box 1034, SE- 551 11 Jönköping, Sweden. eva.norrby@alt.se
Abstract:
The aim of this study was to examine the reliability of the new instrument "DOA--a dialogue about ability related to work" [6]. DOA was developed using the Model of Human of Occupation as a theoretical base [12,13]. The instrument is divided into two sections; client self-assessment and professional assessment focusing on the individual's ability to perform work-related activities. Assessments are followed by a dialogue to distinguish goals for the return-to-work process based on the client's own preferences [6,14]. 34 outpatients' clients and 14 professionals from four clinics within psychiatric work rehabilitation in Sweden participated in the study. The Spearman Rank Correlation test generally showed acceptable significant correlations in test-retest (n=34). A greater part of items correlated "moderate to good" (r=0.51-0.75). In the raters' test (n=14) Percentage of agreement (PA) was good ranging between 93.1%-96.5%, which is above the acceptable criteria of 80%. There were no significance differences between the raters. The study has indicated that items in DOA work with generally good reliability to measure ability related to work. The instrument was demonstrated to be a reliable therapeutic tool in goal setting for return-to-work in a position outside of the clients' preferences.
Related Concept Videos
Reliability and Validity
Distribution Reliability and Automation
Oppositional Defiant Disorder
Diagnostic Criteria and...
Halo Effect
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Goodness-of-Fit Test