Development of an Inconsistent Responding Scale for the Big Five Inventory-2

The Big Five Inventory - 2 (BFI-2) is a commonly used self-report assessment of normal personality trait domains (Extraversion, Agreeableness, Conscientiousness, Negative Emotionality, Open-Mindedness) and facets. To date, however, no direct measures of response distortion have been developed for it to identify potentially invalid responses. Such distortions (e.g., careless or random responding) can adversely impact data quality. The current study developed and provided initial validation data for an inconsistent responding scale within the BFI-2 to identify careless responders using two large undergraduate samples and a community sample. To create the scale, we first identified highly correlated BFI-2 item pairs in one undergraduate sample (N = 1,461) and then computed a total score by summing the absolute differences of these item pairs. This scale, the Detection of Response Inconsistency Procedure (DRIP), differentiated randomly generated and genuine data and generally correlated as expected with personality domains and other inconsistent responding scales across samples. The DRIP also incrementally predicted random data beyond a composite of items with exceptionally high or low base rates of endorsement from the Comprehensive Infrequency/Frequency Item Repository. We provide recommendations for DRIP cut scores that can detect careless responding while balancing sensitivity and specificity.