Related Experiment Video
Updated: Aug 8, 2026
08:33
A Cross-Disciplinary and Multi-Modal Experimental Design for Studying Near-Real-Time Authentic Examination Experiences
Published on: September 4, 2019
Efficient validation of teaching and learning using multiple-choice exams
Mark DeSantis1, Thomas A McKean
1Department of Biological Sciences and WWAMI Medical Education Program, University of Idaho, Moscow, Idaho 83844, USA. starfish@uidaho.edu
Advances in Physiology Education
|February 21, 2003
Summary
First-year medical students significantly improved their neuroscience knowledge, nearly doubling their scores after an introductory course. A novel matrix tool also proved effective for evaluating test questions.
Area of Science:
- Neuroscience Education
- Medical Curriculum Development
- Educational Assessment
Background:
- Introductory neuroscience courses are crucial for first-year medical students.
- Assessing learning effectiveness and test validity is essential for curriculum improvement.
Purpose of the Study:
- To quantify learning gains in neuroscience for first-year medical students.
- To evaluate a computer-generated matrix for assessing medical test question validity.
Main Methods:
- Pre- and post-course multiple-choice tests were administered to assess knowledge acquisition.
- A two-dimensional computer-generated matrix was used to analyze test question validity and value.
Main Results:
- Student performance on neuroscience material improved significantly, with mean scores increasing from 41.8% to 81.4%.
- Learning gains were inversely proportional to initial knowledge, indicating targeted improvement.
- The matrix evaluation of test questions generally aligned with classical pedagogical analysis, offering a flexible and intuitive assessment method.
Conclusions:
- The introductory neuroscience course effectively enhanced medical students' knowledge.
- The computer-generated matrix shows promise as a valuable tool for educational assessment in medical training.
Related Concept Videos
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:03Data Validation
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
01:13Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
01:09Comparing Experimental Results: Student's t-Test
The t-test is a statistical method used to compare the sample mean with a population mean or compare two means from two data sets. The test statistic is calculated from the standard deviation, mean, and number of measurements in the data set at a selected confidence interval and then compared to a table of critical values at this confidence level. If the test statistic is smaller than the critical value, the null hypothesis is accepted. In this case, we state that the difference between the...
01:15Data Validation
Method validation is a crucial process in analytical chemistry designed to confirm that a given method consistently produces reliable and high-quality results. This process is essential when a method is applied to different sample matrices or when procedural modifications are made, ensuring that the results meet acceptable standards across various applications.
Key parameters for method validation include:
Key parameters for method validation include:
01:29Theory of Attribution II: Kelley's Covariation Theory
Attribution theory plays a crucial role in social psychology, helping to explain how individuals interpret the causes of behavior. One prominent model within this field is Harold Kelley's covariation theory, which provides a systematic approach to determining whether internal traits or external circumstances drive a person's actions. The model posits that individuals rely on three key types of information—consensus, consistency, and distinctiveness—to make these judgments.Consensus: Comparing...