Related Experiment Videos
When Assessment Theory Meets Generative AI: Reimagining SBA Design in Medical Education
Nora Al-Shawee1, Gerry McElvaney2, Judith Strawbridge3
1Department of medicine, School of Medicine, Royal College of Surgeons in Ireland, IE.
Abstract:
Current evaluations of generative artificial intelligence (GenAI) in item-writing within medical education often concentrate on isolated dimensions such as validity or reliability, overlooking the broader theoretical foundations that underpin a trustworthy assessment design. This narrow emphasis risks oversimplifying GenAI's role and obscuring how its adoption reshapes the relationship between quality, efficiency, and educational value. To address this complexity, this paper presents the Co-Created SBA Design (CCSD) framework, which reconceptualises assessment theory for the GenAI era through the lens of Van der Vleuten's Utility Index. The framework offers a coherent structure for integrating GenAI into Single Best Answer development, maintaining equilibrium across the Utility Index dimensions while redefining collaboration among educators, higher education institutions, and GenAI, a technological partner that enriches the item-writing process. Within this triadic model, each contributor plays a distinct yet complementary role in sustaining assessment quality. Collectively, their interaction ensures that validity, reliability, educational impact, acceptability, and cost-efficiency remain balanced, supporting both educational integrity and sustainable innovation in medical education.
Related Concept Videos
Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Behavior Modification
A real-world application of operant conditioning principles is applied...
Nursing Process for Patient and Caregiver Teaching I: Assessment and Diagnosis
It is critical to determine the patient's learning needs during the assessment. Determination of learning needs compounds data...