Understanding and controlling response bias in needs assessment studies

Area of Science:

• Social Psychology
• Survey Methodology
• Public Health Research

Background:

• Needs assessment studies often rely on self-reported agency awareness.
• Response biases can significantly impact the accuracy of survey data.
• Understanding factors influencing overclaiming is crucial for reliable data collection.

Purpose of the Study:

• To identify and quantify the impact of "agency awareness overclaiming" on needs assessment findings.
• To investigate demographic and psychological correlates of agency awareness overclaiming.
• To differentiate overclaiming from other response biases like social desirability.

Main Methods:

• Analysis of survey data from a needs assessment study.
• Identification of respondents exhibiting "agency awareness overclaiming" by reporting awareness of fictitious agencies.
• Statistical correlation analysis between overclaiming behavior and demographic factors (age, race) and other response styles (general overclaiming, social desirability, acquiescence).

Main Results:

• Agency awareness overclaiming was found to inflate estimates of awareness for real agencies.
• Overclaimers reported awareness of significantly more real agencies compared to non-overclaimers.
• Age was positively correlated with overclaiming; African Americans showed higher rates of overclaiming than Caucasians.
• Agency awareness overclaiming correlated with general overclaiming but not with social desirability or acquiescence.

Conclusions:

• Agency awareness overclaiming is a significant response bias that inflates needs assessment results.
• Demographic factors, particularly age and race, are associated with this overclaiming bias.
• Future needs assessments should consider methods to mitigate or account for agency awareness overclaiming to improve data validity.