Related Experiment Videos
Medical school preadmission interviews: are structured interviews more reliable than unstructured interviews?
Rick Axelson1, Clarence Kreiter, Kristi Ferguson
1Department of Family Medicine, University of Iowa, Iowa City, Iowa 52242, USA. rick-axelson@uiowa.edu
Teaching and Learning in Medicine
|October 12, 2010
Summary
The unstructured medical school preadmission interview format is more reliable than the structured format. Combining both formats provides the most reliable scores for applicant assessment.
Area of Science:
- Medical Education Research
- Admissions Process Optimization
- Psychometrics in Healthcare Training
Background:
- Medical education literature advocates for structured preadmission interviews.
- Empirical evidence supporting structured interview reliability is limited.
- This study addresses the evidence gap in interview format effectiveness.
Purpose of the Study:
- To evaluate the reliability of structured versus unstructured interview components.
- To determine the contribution of each interview format to overall reliability.
- To inform best practices for medical school admissions interviews.
Main Methods:
- Conducted three univariate G studies on 3,043 interview ratings.
- Performed one multivariate G study using data from 168 applicants with dual interviews.
- Analyzed interrater and test-retest reliability for different interview structures.
Main Results:
- Unstructured interview components demonstrated higher interrater and test-retest reliability.
- Combining structured and unstructured interview measures resulted in superior overall reliability.
- Neither format alone achieved the reliability of a combined approach.
Conclusions:
- Current recommendations for structured medical school interviews may require reevaluation based on reliability.
- A balanced approach considering both structured and unstructured elements is recommended.
- Future interview design should prioritize validity, fairness, and reliability.
Related Concept Videos
01:29Data Collection II
The nursing history captures and records the patient's health status, so that a care plan evolves to meet the patient's individual needs. The nursing health history is a part of the initial assessment. A comprehensive history covers all health dimensions and plays a significant role in the assessment process. A comprehensive history includes the patient's biographical information, reasons for seeking health care, expectations, present and past health history, medications, and family,...
02:16Surveys
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
02:07Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
01:15Bioavailability Study Design: Healthy Subjects Versus Patients
Bioavailability studies are essential for evaluating a drug's therapeutic efficacy and understanding its absorption patterns under various physiological conditions. Conducting such studies on target patient populations provides more relevant data by simulating real-world disease states. However, practical challenges often necessitate the use of young, healthy adult volunteers as study subjects.Patients may exhibit altered drug absorption patterns due to the effects of the disease itself,...
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...