High test-retest reliability of the Alcohol Use Disorders Identification Test-Consumption (AUDIT-C) questionnaire...

The Alcohol Use Disorders Identification Test-Consumption (AUDIT-C) is a three-item screening measure of unhealthy alcohol use that is widely used in healthcare settings. Evidence shows high test-retest reliability of the AUDIT-C in research samples, but most studies had limited external validity and used small samples that could not be used to evaluate reliability across demographic subgroups and/or screening modalities. This study evaluates the test-retest reliability of the AUDIT-C completed in routine care in a large primary care sample, including across demographic subgroups defined by age, sex, race, ethnicity, and screening modality (i.e., completed in-clinic or online).

We used electronic health record (EHR) data from Kaiser Permanente Washington. The sample included 18,491 adult primary care patients who completed two AUDIT-C screens 1-21 days apart as part of routine care in 2021. Test-retest reliability was evaluated for AUDIT-C total scores (0-12) and for a binary measure indicating unhealthy alcohol use (scores ≥3 women, ≥4 men). Using previously established cutoffs, we interpreted reliability coefficients >0.75 as indicating "excellent" reliability.

AUDIT-C screens completed in routine care and documented in EHRs had excellent test-retest reliability for total scores (ICC = 0.87, 95% CI: 0.87-0.87) and the binary indicator of unhealthy alcohol use (κ = 0.79, 95% CI: 0.78-0.80). Reliability coefficients were good to excellent across all demographic groups and for in-clinic and online modalities. Higher reliability was seen when both screens were completed through online patient portals (ICC = 0.93, 95% CI: 0.93-0.93) versus in-clinic (ICC = 0.81, 95% CI: 0.79-0.82) or when one screen was completed using each modality (ICC = 0.83, 95% CI: 0.82-0.83). Lower reliability was seen in American Indian/Alaska Native (ICC = 0.82, 95% CI: 0.75-0.87) and multiracial individuals (ICC = 0.82, 95% 0.80-0.84).

In real-world routine care conditions, AUDIT-C screens have excellent test-retest reliability across demographic subgroups and modalities (online and in-clinic). Future research should examine why reliability varies slightly across modalities and demographic subgroups.