Related Experiment Video
Updated: Jun 23, 2026
14:49
Conducting Respiratory Oscillometry in an Outpatient Setting
Published on: April 8, 2022
Reliability of evaluation for communication competency in pharmaceutical objective structured clinical examination
Yoshie Kubota1, Yoshitaka Yano, Takeshi Morimoto
1Graduate School of Pharmaceutical Sciences, Kyoto University, Kyoto, Japan.
Summary
Reliability issues in pharmaceutical objective structured clinical examinations (OSCE) were found. Using rating scales and carefully selected items can improve the evaluation of student communication skills.
Area of Science:
- Medical Education
- Pharmacy Education
- Communication Skills Assessment
Background:
- Objective Structured Clinical Examinations (OSCE) are crucial for training pharmaceutical students.
- Evaluating communication skills in medical interviews during OSCEs requires reliable methods.
- The reliability of current pharmaceutical OSCE evaluation methods needs further investigation.
Purpose of the Study:
- To investigate the reliability of evaluation methods used in pharmaceutical OSCEs.
- To identify reasons for score disagreements between raters in pharmaceutical OSCEs.
- To propose improvements for evaluating student communication skills in pharmaceutical OSCEs.
Main Methods:
- Reviewing evaluation scores and video recordings from a pharmaceutical OSCE trial.
- Two experienced raters re-evaluated student performance using video recordings.
- Comparing re-evaluation scores with scores from the examination day.
Main Results:
- A disagreement ratio of 14.5% was observed between raters.
- Reasons for disagreement were unidentifiable for 63 items assessing communication skills like 'actively listen' and 'empathy'.
- Disagreements may stem from the use of binary scoring checklists with differing rater criteria.
Conclusions:
- Current evaluation methods in pharmaceutical OSCEs may lack sufficient reliability, particularly for communication skills.
- Careful selection of performance evaluation items is recommended.
- Implementing rating scales instead of binary checklists could enhance the adequacy of evaluations, especially for communication aptitude.
Related Concept Videos
01:15Nursing Evaluation
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
Section...
Section...
01:08Role of Communication in the Nursing Process III: Evaluation and Documentation
A successful patient outcome depends mainly on the evaluation stage of the nursing process. Evaluation determines effectiveness by reviewing what was done previously after the completion of nursing interventions. Every time a healthcare professional steps in or administers treatment, they must reassess or evaluate the action to ensure the intended result. During the evaluation phase, there are three probable patient outcomes:
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:23Methods of Documentation V: CBE
Charting by Exception, or CBE, is a method of documentation used in healthcare, particularly in nursing, that focuses on documenting only significant or abnormal findings rather than recording every detail. This approach aims to streamline the documentation process, improve efficiency, and ensure that healthcare providers can quickly identify deviations from normalcy in patient assessments.
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
01:26Types of Reports III: Telephone and Verbal Reports
Telephone and Verbal Reports in healthcare settings are two communication methods for conveying therapeutic instructions from healthcare providers to nurses or other healthcare staff.
Here's an overview of each type:
Telephone Orders
Here's an overview of each type:
Telephone Orders