Improving the Assessment of Implicit Motives Using IRT: Cultural Differences and Differential Item Functioning

Area of Science:

• Psychology
• Motivational Psychology
• Psychometrics

Background:

• Implicit motives are assessed via text analysis in response to picture cues.
• Traditional methods may not account for motive competition or dynamic strength reduction.
• Item response theory (IRT) offers advanced measurement models.

Purpose of the Study:

• To investigate differential item functioning (DIF) in implicit motive measures using a dynamic Thurstonian item-response theory model (DTM).
• To explore the applicability of the DTM for cross-cultural comparisons of implicit motives.
• To identify potential cultural biases in existing implicit motive assessment tools.

Main Methods:

• Application of the dynamic Thurstonian item-response theory model (DTM).
• Differential item functioning (DIF) analysis on data from the Operant Motive Test (OMT).
• Cross-cultural comparison using data from Cameroon, Germany, and Costa Rica.

Main Results:

• No evidence of DIF was found in 9 out of 12 pictures.
• Evidence of DIF was identified in 3 pictures, suggesting potential cultural variations.
• A partial invariance model was successfully specified for latent mean difference analysis.

Conclusions:

• The DTM is a viable tool for examining DIF in implicit motive measures.
• Partial invariance models can be used to study cross-cultural differences in implicit motives.
• Future research should leverage IRT and DIF methods for nuanced implicit motive assessment across diverse populations.