Does Response Format Matter? The Psychometric Effects of Filter Questions on Self-Reported Symptom Frequencies.

Area of Science:

• Health measurement
• Psychometric analysis
• Survey methodology

Background:

• The presence-severity response format is widely used in health surveys.
• It employs a filter question to ascertain symptom presence before assessing severity.
• Limited research exists comparing its psychometric properties to traditional single-item formats.

Purpose of the Study:

• To investigate the influence of filter questions on item responses and characteristics.
• To compare the presence-severity format with the traditional single-item format in health questionnaires.

Main Methods:

• Utilized two distinct experimental designs to assess response patterns.
• Analyzed the impact of filter questions on short, health-related questionnaires.

Main Results:

• Filter questions significantly affect response patterns and item psychometric properties, varying by construct.
• The presence-severity format leads to decreased symptom reporting and loss of individual difference information.
• These effects are most pronounced for individuals with mild symptoms.

Conclusions:

• The presence-severity format can alter measurement outcomes, particularly for mild symptom experiences.
• Researchers should consider the potential impact of filter questions on data quality and interpretation.
• Recommendations for measurement practices are provided to mitigate these effects.