How do medical students actually think while solving problems in three different types of clinical assessments in...

This study aimed to explore students' cognitive patterns while solving clinical problems in three different types of assessments - clinical performance examination (CPX), multimedia case-based assessment (CBA), and modified essay question (MEQ) - and thus, to understand how different types of assessments can afford different thinking.

A total of six test-performance cases from two fourth-year medical students were used for a cross-case study. Data were collected through one-on-one interviews using a stimulated recall protocol where students were: 1) shown videos of themselves taking each assessment and 2) asked to elaborate on what they were thinking. The unit of analysis was the smallest phrases or sentences, from the participants' narratives, representing a meaningful cognitive occurrence. The narrative data were reorganized chronologically and then analyzed according to a frame of hypothetico-deductive reasoning as clinical reasoning.

Both participants demonstrated similar patterns in their proportional frequencies of clinical reasoning on the same clinical assessment. The results also revealed that the three different assessment types may afford different aspects of clinical reasoning. For example, the CPX highly promoted the participants' reasoning related to inquiry strategy, while the MEQ highly promoted hypothesis generation. Similarly, the participants' data analysis and synthesis were more afforded by the CBA than the other types.

This study discovered that different assessment design affords different thinking in problem-solving. This finding can contribute to leveraging ways of improving current clinical assessments. Importantly, the research method used in this study can be utilized as an alternative way of examining the validity of clinical assessments.