Generalizability of a composite student selection procedure at a university-based chiropractic program

Area of Science:

• Health professions education research
• Admissions and selection processes
• Chiropractic education

Background:

• Non-cognitive criteria supplement academic grades in chiropractic student selection.
• Reliability of these non-cognitive criteria in chiropractic education is underexplored.
• Generalizability of composite non-cognitive variables for health science admissions requires further investigation.

Purpose of the Study:

• To estimate the generalizability of a composite admissions procedure for a chiropractic program.
• To evaluate the reliability of individual non-cognitive admission variables: application form, motivational essay, common knowledge test, and interview.

Main Methods:

• Analysis of data from 105 chiropractic applicants at the University of Southern Denmark.
• Double scoring of each admission parameter by two independent, blinded raters.
• Estimation of variance components using a mixed-effects model and restricted maximum likelihood; calculation of generalizability coefficients.

Main Results:

• High generalizability (G=1.00) for the common knowledge test and good generalizability (G=0.88) for the admission interview.
• Good generalizability (G=0.75) for application form information and moderate generalizability (G=0.50) for the motivational essay.
• The composite admission procedure demonstrated good overall generalizability (G(c) = 0.80).

Conclusions:

• A composite admission procedure for chiropractic programs can achieve good generalizability.
• Optimal weighting of variables and adequate sampling are crucial for maximizing generalizability.
• Further research is needed to address limitations and refine admission processes.