Adaptive Comparative Judgment: A Tool to Support Students' Assessment Literacy.
Journal of Veterinary Medical Education
|June 6, 2017
Summary
Veterinary students effectively ranked assessment answers using adaptive comparative judgment (ACJ), showing strong agreement with faculty marks. This technology-enhanced learning process improved topic understanding and generic skills for students.
Area of Science:
- Veterinary Education
- Educational Technology
- Assessment Methods
Background:
- Comparative judgment offers accurate ranking through item comparison.
- Adaptive comparative judgment (ACJ) automates this process using technology.
- ACJ presents pairs of student work iteratively for evaluation.
Purpose of the Study:
- To evaluate the effectiveness of an online ACJ system in veterinary education.
- To compare student-generated rankings with faculty-assigned objective marks.
- To explore student perceptions and learning outcomes from the ACJ process.
Main Methods:
- An online ACJ system presented veterinary students (n=154) with 20 anonymized answers from a previous cohort.
- Student rankings of the answers were compared against objective marks assigned by experienced faculty.
- Student time spent on judgments and self-reported learning experiences were recorded.
Main Results:
- A strong positive correlation was observed between student rankings and faculty marks.
- A weak positive correlation linked judgment time to student performance on similar exam questions.
- 78% of students reported learning from the ACJ process, though only half found it a good use of time.
Conclusions:
- Adaptive comparative judgment (ACJ) is a viable and effective method for ranking student assessments in veterinary education.
- The ACJ process facilitates learning, enhancing both subject matter comprehension and general academic skills.
- Further research could optimize ACJ implementation to maximize student engagement and perceived value.
Related Concept Videos
01:26Metacognition
922
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
922
01:24Nursing Process for Patient and Caregiver Teaching I: Assessment and Diagnosis
2.6K
The nursing process provides a clinical decision-making framework for patients and families to establish and implement a personalized care plan. Since part of the nurse's duties is to teach patients, the steps of the nursing process are the most effective way to approach instruction. The nursing process and the teaching-learning process are inextricably linked.
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...
2.6K
01:12Hindsight Biases
4.5K
Hindsight bias leads you to believe that the event you just experienced was predictable, even though it really wasn’t. In other words, you knew all along that things would turn out the way they did. Can you relate this to the phrase "Hindsight is 20/20" now?
4.5K
01:20Lazarus's Cognitive Appraisal Theory
2.3K
Cognitive psychologist Richard Lazarus proposed the cognitive-mediational theory of emotions, which emphasizes how individuals' assessments of stressors significantly affect their experience of stress. According to Lazarus, the stress response is determined by a two-step appraisal process: primary appraisal and secondary appraisal. These cognitive appraisals help individuals evaluate the potential impact of a stressor and determine the adequacy of their coping resources.
Primary Appraisal:...
Primary Appraisal:...
2.3K
02:57The Sense of Self: Reflected Self-Appraisal and Social Comparison
56.3K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
56.3K
01:29Self-Evaluation Maintenance Model
351
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
351