Related Experiment Video
Updated: Feb 6, 2026
07:11
Author Spotlight: Emerging Technologies and Advanced Tools for Decoding Metabolomics Data Analysis
Published on: November 10, 2023
3.3K
A tool for the rapid postexamination analysis of examination data using classical test theory, generalizability
Mohsen Tavakol1, Claire Stewart1
1Education Centre, School of Medicine, University of Nottingham, Nottingham, United Kingdom.
Summary
A new free tool offers medical educators efficient psychometric analysis for assessments, comparing classical test theory, generalizability theory, and Rasch modeling simultaneously. This supports reliable, valid evaluations and enhances patient safety.
Area of Science:
- Medical Education
- Psychometrics
- Health Professions Education
Background:
- Effective postexamination psychometric analysis is crucial for medical education assessments, ensuring reliability, validity, and fairness.
- Barriers include expensive software, limited expertise, and budget constraints, hindering timely and accurate analysis.
- Patient safety is directly linked to the quality of medical education assessments.
Purpose of the Study:
- To introduce a free, user-friendly web-based tool for postexamination psychometric analysis.
- To enable health professions educators to conduct rapid and accurate analyses using classical test theory (CTT), generalizability theory (GT), and the Rasch model (RM).
- To overcome common barriers in medical educational settings for psychometric evaluation.
Main Methods:
- A web-based tool was developed and tested at the University of Nottingham in 2025.
- The tool processes postexamination data, providing real-time item metrics, reliability coefficients, and diagnostic reports.
- It allows simultaneous comparison of CTT, GT, and RM for comprehensive review.
Main Results:
- The tool rapidly generated CTT measures, GT variance components, and Rasch model calibrations from a medical assessment dataset.
- It produced detailed outputs including G-coefficient, phi-coefficient, standard error of measurement, and Rasch reliability.
- Analysis included item-person maps, misfit statistics, and characteristic curves for test and item performance.
Conclusions:
- The tool facilitates rapid and comprehensive psychometric analysis for medical education assessments.
- It democratizes advanced psychometric techniques, making them accessible to educators without specialized expertise or costly software.
- Future development will enhance evaluation of multiple-choice question quality by analyzing response options.
Related Concept Videos
02:35Band Theory
17.2K
When two or more atoms come together to form a molecule, their atomic orbitals combine and molecular orbitals of distinct energies result. In a solid, there are a large number of atoms, and therefore a large number of atomic orbitals that may be combined into molecular orbitals. These groups of molecular orbitals are so closely placed together to form continuous regions of energies, known as the bands.
The energy difference between these bands is known as the band gap.
Conductor, Semiconductor,...
The energy difference between these bands is known as the band gap.
Conductor, Semiconductor,...
17.2K
02:31Scientific Laws and Theories
88.9K
Scientific Laws
88.9K
02:06Social Exchange Theory
40.8K
We have discussed why we form relationships, what attracts us to others, and different types of love. But what determines whether we are satisfied with and stay in a relationship? One theory that provides an explanation is social exchange theory. According to social exchange theory, we act as naïve economists in keeping a tally of the ratio of costs and benefits of forming and maintaining a relationship with others (Rusbult & Van Lange, 2003).
40.8K
03:51Molecular Orbital Theory II
27.5K
Molecular Orbital Energy Diagrams
27.5K
00:56Attribution Theory
13.8K
Behavior is a product of both the situation (e.g., cultural influences, social roles, and the presence of bystanders) and of the person (e.g., personality characteristics). Subfields of psychology tend to focus on one influence or behavior over others. Situationism is the view that our behavior and actions are determined by our immediate environment and surroundings. In contrast, dispositionism holds that our behavior is determined by internal factors (Heider, 1958).
13.8K
02:59The Atomic Theory of Matter
128.4K
The earliest recorded discussion of the basic structure of matter comes from ancient Greek philosophers. Leucippus and Democritus argued that all matter was composed of small, finite particles that they called atomos, meaning “indivisible.” Later, Aristotle and others came to the conclusion that matter consisted of various combinations of the four “elements” — fire, earth, air, and water — and could be infinitely divided. Interestingly, these philosophers...
128.4K