Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

QUAID: a questionnaire evaluation aid for survey methodologists.

A C Graesser1, K Wiemer-Hastings, R Kreuz

  • 1Department of Psychology, University of Memphis, TN 38152-6400, USA. a-graesser@memphis.edu

Behavior Research Methods, Instruments, & Computers : a Journal of the Psychonomic Society, Inc
|June 30, 2000
PubMed
Summary

The QUAID software tool aids researchers in improving survey question wording by identifying comprehension issues. It successfully detects five common problem types, enhancing questionnaire reliability and validity.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

FGF23-klotho axis, bone fractures, and arterial stiffness in dialysis: a case-control study.

Osteoporosis international : a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA·2018
Same author

Tests of a holistic chunking model of sentence memory through analyses of noun intrusions.

Memory & cognition·2013
Same author

[Cardiovascular manifestations in patients with COPD].

Revue des maladies respiratoires·2008
Same author

Lecozotan (SRA-333): a selective serotonin 1A receptor antagonist that enhances the stimulated release of glutamate and acetylcholine in the hippocampus and possesses cognitive-enhancing properties.

The Journal of pharmacology and experimental therapeutics·2005
Same author

Oxidative enzyme activities of the vastus lateralis muscle and the functional status in patients with COPD.

Thorax·2000
Same author

Synthesis and SAR of adatanserin: novel adamantyl aryl- and heteroarylpiperazines with dual serotonin 5-HT(1A) and 5-HT(2) activity as potential anxiolytic and antidepressant agents.

Journal of medicinal chemistry·1999

Area of Science:

  • Survey Methodology
  • Social Sciences
  • Linguistics

Background:

  • Questionnaire design is crucial for reliable and valid survey data.
  • Identifying and rectifying question comprehension issues is a key challenge for researchers.
  • Existing methods for evaluating question quality can be time-consuming and subjective.

Purpose of the Study:

  • To evaluate the effectiveness of QUAID (question-understanding aid), a software tool designed to assist in improving survey questionnaire wording.
  • To assess QUAID's ability to identify specific question comprehension problems.
  • To compare QUAID's performance against human language expert evaluations.

Main Methods:

  • QUAID was used to analyze a corpus of 505 questions from 11 U.S. Census Bureau surveys.

Related Experiment Videos

  • The software's output was compared with ratings from language experts on five predefined problem categories.
  • Performance was evaluated using metrics such as hit rates, false alarm rates, d' scores, recall, and precision.

    • Main Results:

    • QUAID demonstrated the ability to identify five classes of question comprehension problems: unfamiliar technical terms, vague/imprecise relative terms, vague/ambiguous noun phrases, complex syntax, and working memory overload.
    • The software's performance was validated against expert linguistic evaluations.
    • While effective, the study indicates potential for future improvements in QUAID's accuracy and scope.

    Conclusions:

    • QUAID is a valuable tool for survey methodologists and social scientists seeking to enhance question comprehension.
    • The software assists in identifying specific linguistic and cognitive challenges within survey questions.
    • Further development of QUAID is expected to further improve its utility in questionnaire design and data quality assurance.