Exploring variability and sources of measurement error in alcohol expectancy questionnaire reliability coefficients:...

Area of Science:

• Psychometrics
• Substance Abuse Research
• Meta-Analysis

Background:

• The Alcohol Expectancy Questionnaire (AEQ) is frequently used in substance abuse research.
• Assessing the reliability of AEQ subscales is crucial for valid interpretation of findings.
• Reliability Generalization (RG) is a meta-analytic technique for evaluating score reliability.

Purpose of the Study:

• To evaluate the reliability coefficients of Alcohol Expectancy Questionnaire (AEQ) subscales using Reliability Generalization.
• To identify typical reliability levels and sources of measurement error for AEQ subscales across published studies.
• To examine the impact of study characteristics on AEQ score reliability.

Main Methods:

• A meta-analytic review of 71 studies was conducted using PsycINFO and PubMed.
• Studies were coded on 10 dimensions potentially influencing score reliability.
• Reliability coefficients for AEQ subscales were extracted and analyzed.

Main Results:

• Only 37% of studies reported reliability coefficients.
• Average score reliability varied significantly across AEQ subscales and samples.
• Arousal/Interpersonal Power and Sexual Enhancement subscales exhibited the most variability in reliability.
• Gender and racial homogeneity were key predictors of score reliability magnitude.

Conclusions:

• The AEQ generally yields reliable scores, with exceptions for specific subscales.
• The Arousal/Interpersonal Power and Sexual Enhancement subscales require further investigation due to low reliability.
• Future research should focus on AEQ factor structure and item consistency.
• Authors are urged to report AEQ reliability estimates to ensure accurate statistical analysis and interpretation.