Related Experiment Video
Updated: May 12, 2026
05:26
Enactive Phenomenological Approach to the Trier Social Stress Test: A Mixed Methods Point of View
Published on: January 7, 2019
A Behaviourally Anchored Checklist for Mental Health Occupational Therapy Intake Interviews: Development and
Yasuhisa Nakamura1, Shohei Mori2, Shuji Kijima1
1Department of Rehabilitation, Division of Occupational Therapy, Faculty of Health Sciences, Nihon Fukushi University, Handa City, Aichi Prefecture, Japan.
Perspectives on Medical Education
|May 11, 2026
Summary
A new checklist reliably assesses occupational therapy students' intake interview skills in brief encounters. This tool supports rater calibration and feedback, even without multi-station Objective Structured Clinical Examinations (OSCEs).
Area of Science:
- Occupational Therapy Education
- Clinical Skills Assessment
- Psychometrics
Background:
- Assessing core competencies like intake interviews in mental health occupational therapy is crucial.
- Existing tools for evaluating brief, observed encounters are limited.
- This study addresses the need for reliable assessment instruments in occupational therapy education.
Purpose of the Study:
- To develop and validate a 16-item behaviourally anchored checklist/rubric for assessing intake interview performance.
- To examine the scoring reliability of this checklist in a simulated clinical encounter (Objective Structured Clinical Examination - OSCE format).
- To provide a tool for structured formative feedback in occupational therapy training.
Main Methods:
- A cross-sectional study involving 60 occupational therapy students and 2 raters.
- Development of a 16-item behaviourally anchored checklist/rubric.
- Assessment of performance across attitude, interview skills, and evaluation domains using standardized patient scenarios.
- Statistical analysis including Cronbach's alpha, Intraclass Correlation Coefficients (ICCs), and Bland-Altman analysis.
Main Results:
- High internal consistency was found for all domains (Cronbach's α = 0.850-0.887) and total scores (α = 0.816-0.817).
- Inter-rater agreement for total scores ranged from 0.761 to 0.929 across scenarios.
- Domain-level ICCs indicated acceptable to high agreement, with evaluation showing the strongest agreement (0.794-0.979).
Conclusions:
- The developed behaviourally anchored checklist demonstrates high internal consistency and acceptable inter-rater reliability for assessing intake interview performance.
- This instrument operationalizes interpersonal competencies as observable behaviors, aiding rater calibration and feedback.
- The checklist is suitable for single-station assessments, offering a viable option where multi-station OSCEs are not feasible.
Related Concept Videos
01:22Self-Report Tests of Personality
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
01:26Modeling in Therapy
Modeling, a key technique in therapy, uses observational learning to help clients acquire and practice new skills by watching therapists demonstrate desired behaviors. This approach, rooted in Albert Bandura's concept of vicarious learning, plays a significant role in therapeutic interventions for various psychological conditions, including social anxiety, ADHD, and depression.
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
Participant Modeling
Participant modeling involves therapists demonstrating calm and effective behaviors in situations...
01:25Interpersonal Psychotherapy
Interpersonal psychotherapy (IPT) is a structured, time-limited therapeutic approach initially developed to treat depression. It integrates key concepts from psychodynamic, humanistic, and cognitive-behavioral therapies, making it a uniquely eclectic framework. The therapy is rooted in the interpersonal theories of Adolph Meyer and Harry Stack Sullivan, as well as John Bowlby's attachment theory, and focuses on the interplay between interpersonal relationships and emotional well-being.