Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

The Rater Applied Performance Scale: development and reliability.

Joshua Lipsitz1, Ken Kobak, Alan Feiger

  • 1Anxiety Clinic #69, New York State Psychiatric Institute/College of Physicians and Surgeons, Columbia University, 1051 Riverside Drive, NY 10032, USA. Lipsitz@pi.cpmc.columbia.edu

Psychiatry Research
|July 21, 2004
PubMed
Summary

The Rater Applied Performance Scale (RAPS) effectively quantifies clinical rater performance during real assessments. This new tool shows good reliability and accuracy, aiding in consistent clinical evaluations.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Paxlovid-induced tacrolimus toxicity in a 16-year-old male with steroid-resistant nephrotic syndrome.

Pediatric nephrology (Berlin, Germany)·2025
Same author

Palliative Care for Dialysis-Dependent Pediatric Patients: A Survey of Providers, Nurses, and Caregivers.

Kidney360·2024
Same author

Vulnerabilities in social anxiety: Integrating intra- and interpersonal perspectives.

Clinical psychology review·2024
Same author

KSADS-COMP Perspectives on Child Psychiatric Diagnostic Assessment and Treatment Planning.

Journal of the American Academy of Child and Adolescent Psychiatry·2021
Same author

Critical review of outcome research on interpersonal psychotherapy for anxiety disorders.

Depression and anxiety·2014
Same author

[Fever phobia in the ultra-religious community in Israel].

Harefuah·2012

Area of Science:

  • Clinical psychology
  • Psychometrics
  • Healthcare quality assessment

Background:

  • Traditional rater reliability studies often use passive tasks like rating videotaped interviews.
  • Limited understanding exists regarding rater performance and scoring consistency during live patient assessments.
  • There is a recognized need for systematic methods to evaluate actual rater performance in clinical settings.

Purpose of the Study:

  • To introduce and validate the Rater Applied Performance Scale (RAPS) for measuring rater performance.
  • To assess the psychometric properties of the RAPS in quantifying rater performance during assessment sessions.
  • To explore the utility of the RAPS in improving the quality and consistency of clinical evaluations.

Main Methods:

  • The Rater Applied Performance Scale (RAPS) was developed to assess six dimensions: adherence, follow-up, clarification, neutrality, rapport, and accuracy.

Related Experiment Videos

  • The RAPS was tested by having two independent reviewers evaluate 20 audiotaped Hamilton Depression Scale rating sessions from a multi-site trial.
  • Correlations were examined between RAPS ratings and objective measures of scoring accuracy determined by expert raters.

    • Main Results:

    • The RAPS demonstrated good internal consistency among its measured dimensions.
    • Satisfactory interrater reliability was achieved for the total RAPS scores.
    • RAPS ratings showed a significant correlation with quantitative measures of scoring accuracy, supporting its validity.

    Conclusions:

    • Preliminary psychometric data indicate that the RAPS is a valuable instrument for quantifying clinical rater performance.
    • The RAPS offers a systematic approach to monitoring and improving the quality of assessment sessions.
    • Potential applications include training, quality assurance, and research in clinical assessment settings.