Do Applicant Reactions to Gamified Cognitive Ability Tests Differ Between High- Versus Low-Stakes Settings?

Although cognitive ability tests are among the best predictors of job and training performance, their acceptance among applicants is limited. However, with the current talent shortage, applicant reactions to assessments have become increasingly important. Gamification is a promising approach for improving reactions to cognitive ability tests. However, it remains unclear how findings from low-stakes studies of gamified assessments generalize to high-stakes settings. In this quasi-experimental study (N = 210), we compared reactions to a gamified cognitive test from a low-stakes simulated selection setting with experimental participants and from a high-stakes selection setting with real applicants. Test takers in both settings completed the same gamified cognitive ability test and then rated several applicant reactions variables. We found a clear effect of the test setting with real applicants showing more positive reactions to the gamified test concerning perceived fairness, test motivation, organizational attractiveness, behavioral intentions, organizational image, clarity of work activity, and enjoyment compared to participants in the low-stakes setting, whereas there were no differences for perceived job-relatedness and opportunity to perform. These findings highlight the influence of test setting on applicant reactions and underscore the importance of examining environmental factors for research on the effects of gamification in cognitive ability testing.