Related Experiment Video
Updated: Oct 26, 2025
07:43
Author Spotlight: A Novel Setup to Conduct Naturalistic Laboratory Experiments with Real Human Actors in Scenarios
Published on: August 4, 2023
2.3K
Exploring the Role of Item Scenario Features on Situational Judgment Test Response Selections
Michael D Wolcott1,2, Nikki G Lobczowski3, Jacqueline M Zeeman4
1The University of North Carolina, Eshelman School of Pharmacy, Chapel Hill, North Carolina wolcottm@email.unc.edu.
American Journal of Pharmaceutical Education
|July 28, 2021
Summary
Changing situational judgment test (SJT) scenario details, like context, significantly impacts how pharmacists and students respond. These scenario features are crucial for accurate SJT design and interpretation.
Area of Science:
- Educational Psychology
- Health Professions Education
- Assessment and Evaluation
Background:
- Situational judgment tests (SJTs) are widely used to assess professional competencies.
- The impact of scenario characteristics on SJT response patterns requires further investigation.
- Understanding how context influences judgment is critical for test validity.
Purpose of the Study:
- To investigate pharmacists' and pharmacy students' perceptions of scenario feature changes in SJTs.
- To determine the effect of altering SJT scenario contexts (e.g., healthcare vs. non-healthcare) on response selection.
- To identify specific scenario features influencing SJT responses.
Main Methods:
- A 12-item SJT measuring empathy was administered to 15 pharmacy students and 15 pharmacists.
- Scenarios were presented in both healthcare and non-healthcare contexts.
- Qualitative data were collected via think-aloud and cognitive interviews to explore response rationale and hypothetical changes.
Main Results:
- Participants indicated they would alter their responses in 51.3% of items if scenario features were changed.
- Four key features influencing responses were identified: examinee information, actors, relationships, and situational details.
- No clear pattern emerged linking specific features to empathy components or participant groups.
Conclusions:
- SJT item scenario features significantly influence examinee response selections.
- These features must be carefully considered during SJT development and validation.
- Further research is needed to quantify the impact of scenario features on SJT performance.
More Related Videos
Related Concept Videos
01:14Fundamental Attribution Error
13.4K
According to some social psychologists, people tend to overemphasize internal factors as explanations—or attributions—for the behavior of other people. They tend to assume that the behavior of another person is a trait of that person, and to underestimate the power of the situation on the behavior of others. They tend to fail to recognize when the behavior of another is due to situational variables, and thus to the person’s state. This erroneous assumption is...
13.4K
01:08The Availability Heuristic
6.7K
A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):
6.7K
00:56Attribution Theory
13.5K
Behavior is a product of both the situation (e.g., cultural influences, social roles, and the presence of bystanders) and of the person (e.g., personality characteristics). Subfields of psychology tend to focus on one influence or behavior over others. Situationism is the view that our behavior and actions are determined by our immediate environment and surroundings. In contrast, dispositionism holds that our behavior is determined by internal factors (Heider, 1958).
13.5K
01:14Decision Making: Traditional Method
4.4K
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.4K
01:22Self-Report Tests of Personality
511
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
511
01:37Reason and Intuition
7.1K
The human brain processes information for decision-making using one of two routes: an intuitive system and a rational system (Epstein, 1994; popularized by Kahneman, 2011 as System 1 and System 2, respectively). The intuitive system is quick, impulsive, and operates with minimal effort, relying on emotions or habits to provide cues for what to do next, while the rational system is logical, analytical, deliberate, and methodical. Research in neuropsychology suggests that the...
7.1K