Can we improve on situational judgement tests?

Area of Science:

• Psychological assessment
• Medical education

Background:

• Situational judgement tests (SJTs) are multiple-choice assessments used to measure professional attributes like empathy and integrity.
• SJTs are increasingly utilized in high-stakes selection processes, such as dental foundation training (DFT), for their ability to rank candidates efficiently.
• Concerns exist regarding the actual constructs measured by SJTs and their potential to disadvantage individuals with developed ethical reasoning skills.

Purpose of the Study:

• To critically evaluate the construct validity of SJTs in professional selection.
• To examine the potential impact of SJTs on candidates with strong ethical reasoning abilities.
• To advocate for the explicit inclusion of ethical reasoning assessment in the DFT selection process.

Main Methods:

• Literature review of SJT psychometric properties.
• Analysis of SJT content in relation to ethical reasoning frameworks.
• Discussion of implications for candidate selection in professional training programs.

Main Results:

• The specific attributes measured by SJTs remain unclear, raising questions about their validity.
• There is a potential for SJTs to unfairly disadvantage applicants who prioritize ethical considerations in their decision-making.
• Current SJT usage in DFT selection may not adequately capture essential ethical competencies.

Conclusions:

• The construct validity of SJTs in assessing professional attributes requires further investigation.
• The dental foundation training selection process should be revised to explicitly incorporate and value ethical reasoning.
• Ensuring fair and effective selection requires assessments that accurately measure the competencies essential for professional practice.