Related Experiment Video
Updated: Jun 21, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
Positive manifold limits the relevance of content-matching strategies for validating selection test batteries
Kevin R Murphy1, Jessica L Dzieweczynski, Yang Zhang
1Department of Psychology, The Pennsylvania State University, University Park, PA 16802, USA. krm10@psu.edu
Abstract:
Inferences about the relationships between scores on selection tests and measures of job performance are often made on the basis of an assessment of the match between the content of the test and the content of the job. However, there is little evidence that these test-to-job comparisons have any bearing on the criterion-related validity of selection tests. The authors show that conclusions reached in analyses of cognitive tests-that content matching is largely irrelevant to criterion-related validity-can be generalized to most sets of selection tests (e.g., psychomotor and performance tests, interview ratings, biodata scores, knowledge tests, work sample tests) that are positively correlated with one another and with the criterion. When the universe of potential predictors shows positive manifold, almost all possible sets of test batteries will yield similar outcomes and show similar validities, regardless of whether the content of these tests matches the content of the job.
Related Concept Videos
Quantifying and Rejecting Outliers: The Grubbs Test
Goodness-of-Fit Test
Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in value between...
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Dose-Response Relationship: Selectivity and Specificity
Reliability and Validity