Related Experiment Video
Updated: May 19, 2026
08:27
Applying an eMASS Customization Program as a Research Tool to Evaluate Consumer Benefits
Published on: September 27, 2019
Admissions file review: applying the multiple independent sampling (MIS) methodology.
Mark D Hanson1, Kulamakan Mahan Kulasegaram, Deborah L Coombs
1Department of Psychiatry, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada. mark.hanson@utoronto.ca
Summary
Multiple independent sampling (MIS) in medical school admissions file review may reduce the halo effect. This method, where raters assess specific components, showed lower reliability but better factor differentiation than holistic scoring.
Area of Science:
- Medical Education
- Admissions Processes
- Psychometrics
Background:
- Holistic assessment in medical school admissions can be susceptible to the halo effect, where one component influences the evaluation of others.
- Multiple independent sampling (MIS) is used for interviews but less explored for written admissions file review.
Purpose of the Study:
- To investigate whether MIS file review can mitigate the halo effect in medical school admissions.
- To compare the psychometric properties of MIS file review with traditional holistic scoring.
Main Methods:
- A stratified random sample of 300 medical school applicant files was selected.
- Files were divided into four components (academic transcript, sketch, statement, references) and rebundled for MIS review by 36 raters.
- Inter-component reliability and factor analysis were compared between MIS and holistic scoring.
Main Results:
- Holistic scoring demonstrated higher inter-component reliability (Cronbach alpha = 0.69) compared to MIS (0.29).
- Factor analysis revealed a single factor for holistic scoring, while MIS identified three distinct factors.
- All applicant files were successfully rescored.
Conclusions:
- MIS file review may reduce the halo effect in admissions file assessment.
- The findings suggest MIS is a viable alternative for evaluating written submissions, potentially offering better differentiation of applicant qualities.
More Related Videos
Related Concept Videos
01:09Random Sampling Method
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
01:06Sampling Methods: Overview
A sample refers to a smaller subset representative of a larger population. In analytical chemistry, studying or analyzing an entire population is often impractical or impossible. Therefore, samples are used to draw inferences and generalize the whole population. The sampling method selects individuals or items from a population to create a sample. Standard sampling methods include random, judgemental, systematic, stratified, and cluster sampling.
In analytical chemistry, the choice of sampling...
In analytical chemistry, the choice of sampling...
01:15Systematic Error: Methodological and Sampling Errors
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
01:13Multiple Comparison Tests
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
00:55Convenience Sampling Method
Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population.
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
Convenience sampling is a non-random method of sample selection; this method selects individuals that are easily accessible and may result in biased data. For example, a marketing...
01:23Mechanistic Models: Compartment Models in Individual and Population Analysis
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least squares (OLS)...