Correcting for range restriction in meta-analysis: A reply to Oh et al. (2023)

Area of Science:

• Psychometrics
• Industrial-Organizational Psychology
• Research Methodology

Background:

• A previous article by Sackett et al. (2022) addressed range restriction corrections in concurrent validation studies.
• Oh et al. (2023) raised questions regarding the recommendations made in Sackett et al. (2022).

Purpose of the Study:

• To respond to critiques by Oh et al. (2023) concerning the application of range restriction corrections.
• To clarify the stance on correcting for range restriction, especially within meta-analytic contexts.

Main Methods:

• The authors re-emphasize their endorsement of range restriction correction when sufficient data is accessible.
• The response focuses on the practical challenges of obtaining necessary data for corrections in meta-analyses.

Main Results:

• The primary focus is on meta-analyses where information on the original applicant pool is frequently unavailable.
• The authors argue that situations with substantial range restriction are less common in meta-analyses than suggested.

Conclusions:

• Correction for range restriction is supported when feasible, but its absence in meta-analyses due to data limitations leads to only modest underestimates of validity.
• The authors maintain that significant range restriction is not the norm in the majority of studies contributing to meta-analyses.