Related Experiment Videos
Developing key-feature problems and examinations to assess clinical decision-making skills
1Department of Medicine, University of British Columbia, Vancouver, Canada.
This paper introduces a new way to test clinical decision-making skills. It focuses on critical steps in solving medical problems. The method uses scenarios followed by questions about those key steps. Examinees can answer in writing or choose from options. The format allows for multiple correct answers. This approach improves test validity and reliability. It accommodates complex clinical tasks. The method provides flexibility in question types and scoring.
Area of Science:
- Medical education assessment
- Clinical decision-making research
- Health professions testing
Background:
Medical educators seek better ways to evaluate clinical reasoning. Traditional testing methods often fail to capture the complexity of real-world decision-making. Prior research has shown that written exams can miss critical thinking steps. No prior work had resolved how to measure essential clinical reasoning processes. That uncertainty drove the development of new assessment formats. This gap motivated a focus on identifying and testing key decision points. Existing tools lacked the flexibility to capture multiple correct responses. This paper introduces a novel approach to clinical problem testing.
Purpose Of The Study:
The study aimed to create a new format for assessing clinical reasoning. The goal was to identify and test critical decision steps in medical scenarios. Traditional exams often overlook these key moments. The authors sought a method that reflects real clinical workflows. They wanted to ensure assessments could capture multiple valid responses. The approach needed to support both written and multiple-choice formats. This format should allow for flexible scoring structures. The purpose was to improve the validity and reliability of medical testing.
Main Methods:
The researchers developed a problem format centered on key features. Each problem begins with a clinical case scenario. Questions focus only on critical decision points in the case. Responses can be written or selected from multiple options. Examinees may provide one or multiple answers per question. Scoring keys can include multiple correct responses. The format allows for different question types and scoring methods. This approach was designed to meet psychometric standards.
Main Results:
The key feature format successfully targets critical decision steps. The method allows for multiple valid responses per question. It supports both written and multiple-choice question types. Scoring keys can include one or several correct answers. This format improves content validity of assessments. It also enhances test score reliability. The approach accommodates complex clinical tasks. The method addresses psychometric requirements effectively.
Conclusions:
The authors propose that this format improves clinical reasoning assessment. The method allows for testing multiple valid responses. It supports different question formats and scoring structures. The approach meets psychometric standards for validity and reliability. The format captures essential decision points in clinical cases. It accommodates the complexity of medical decision-making. The method provides flexibility in test design. The authors suggest this format could enhance medical education assessments.
Frequently Asked Questions
A key feature is a critical step in solving a clinical problem. It represents a decision point essential to resolving the case.
They focus only on critical steps in clinical reasoning. Traditional exams often include irrelevant details.
Yes, answer keys can include one or several correct responses.
Questions can require written responses or multiple-choice selections.
It focuses on essential steps and allows flexible scoring methods.
The authors propose it improves content validity and test reliability.