Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Objective measurement of clinical performance.

G R Norman

    Medical Education
    |January 1, 1985
    PubMed
    Summary

    This study introduces a new method to assess how well students solve problems during simulated patient encounters. The method compares student responses to a standard set of expected answers to derive scores in diagnosis, investigations, and management. The authors tested the method across multiple studies and found it to be reliable and valid. The results suggest that this approach could be useful in medical education for evaluating clinical performance in a structured and objective way.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    The risks of thoroughness: Reliability and validity of global ratings and checklists in an OSCE.

    Advances in health sciences education : theory and practice·2013
    Same author

    Physician-assessment and physician-enhancement programs in Canada.

    The International journal of risk & safety in medicine·2013
    Same author

    Solving problems: how does the family physician do it?

    Canadian family physician Medecin de famille canadien·2011
    Same author

    To see or not to see: a study of after hours telephone calls in a residency program.

    Canadian family physician Medecin de famille canadien·2011
    Same author

    Sore throats in adults: who sees a doctor?

    Canadian family physician Medecin de famille canadien·2011
    Same author

    Factors influencing antibiotic use in acute respiratory tract infections in family practice.

    Canadian family physician Medecin de famille canadien·2011

    Area of Science:

    • Medical education assessment
    • Clinical skills evaluation
    • Educational measurement techniques

    Background:

    Assessing clinical performance remains a challenge in medical education. Traditional methods often rely on subjective observations or lack validation. Prior research has shown that existing tools may not fully capture diagnostic and management processes in real-time encounters. This gap motivated the development of more objective, reliable methods. No prior work had resolved how to systematically evaluate problem-solving in simulated patient encounters. The need for standardized scoring systems is well-recognized in medical training. Yet, no single approach has been widely adopted for its validity and reliability. This paper introduces a novel approach to address these limitations.

    Purpose Of The Study:

    The aim of this study is to evaluate a new method for measuring clinical performance. The method focuses on problem-solving during simulated patient encounters. It assesses diagnosis, investigations, and management. The authors sought to determine if this approach could produce reliable and valid scores. They tested the method across multiple studies. The goal was to establish its usefulness in medical education. The studies aimed to confirm that the method could consistently measure clinical skills. The paper outlines the process and findings of these validation studies.

    Keywords:
    clinical performance evaluationsimulated patient assessmentmedical education toolsaggregate score method

    Frequently Asked Questions

    The aggregate score technique compares student responses to a criterion group to derive scores for diagnosis, investigations, and management.

    The method evaluates problem-solving during simulated patient encounters by comparing listed items to a standard set of expected responses.

    A criterion group provides a standard for comparison, allowing the derivation of scores based on how closely student responses match expected outcomes.

    The study found high inter-rater agreement and consistent scoring across multiple assessments, indicating acceptable reliability.

    Related Experiment Videos

    Main Methods:

    The method involves comparing student responses to a predefined criterion group. Items listed by students are matched against a standard set of expected responses. Scores are derived for each domain: diagnosis, investigations, and management. The process is based on the aggregate score technique. The authors conducted multiple studies to test the method’s reliability. They used simulated patient encounters as the testing environment. Data were collected from student performances and compared against the criterion group. The studies focused on statistical validation and inter-rater agreement.

    Main Results:

    The aggregate score technique showed acceptable reliability across multiple studies. Inter-rater agreement was high, indicating consistent scoring. The method demonstrated concurrent validity when compared to existing tools. Students’ scores aligned with expected performance levels. The technique captured variations in diagnostic and management approaches. No significant discrepancies were found in repeated assessments. The method proved effective in distinguishing between higher and lower performers. These findings suggest the technique is suitable for clinical performance evaluation.

    Conclusions:

    The authors propose that the aggregate score technique is a valid and reliable method for assessing clinical performance. The method’s focus on problem-solving during simulated encounters aligns with educational goals. The studies support its use in medical training environments. The authors suggest that the technique could be integrated into existing assessment frameworks. They emphasize the need for further validation in diverse settings. The method’s structured approach to scoring enhances objectivity. The findings support the use of this technique for evaluating students’ clinical skills. The authors conclude that the method is suitable for use in medical education.

    The method demonstrated concurrent validity when compared to existing tools, with scores aligning with expected performance levels.

    The authors suggest the technique could be integrated into medical education for evaluating clinical skills in simulated encounters.