Addressing Psychometric Limitations of the Attentional Control Scale via Bifactor Modeling and Item Modification

The purpose of this three-part study was to identify and correct psychometric limitations of the Attentional Control Scale (ACS; Derryberry & Reed, 2002) via bifactor modeling and item modification. In Study 1 (N = 956), results from exploratory factor analyses (EFAs) and confirmatory factor analyses (CFAs) suggested that the multidimensionality of the ACS might be a function of a method effect (i.e., reverse coding). In Study 2 (N = 478), reverse-coded items were recoded in a straightforward manner and submitted to EFA. Results supported retention of 15 items and 2 factors. In Study 3 (N = 410), CFA was used to test the model identified in Study 2 and compare it to competing models (i.e., 1-factor, bifactor). The bifactor model exhibited the best fit to the data. However, results from bifactor analysis suggested that the structure of the ACS is more consistent with a unidimensional rather than multidimensional model. Additionally, the second domain-specific factor appears to be redundant with the general factor and both domain-specific factors are poorly defined and might be of little practical value. Taken together, results caution the use of the ACS subscales independent of the total score. Moreover, they support coding ACS items in a straightforward manner.