Methodologic note for child epidemiological surveys: the effects of instructions on estimates of behavior prevalence

C A Woodward1, H B Thomas, M H Boyle

  • 1Department of Psychiatry, Faculty of Health Sciences, McMaster University, Hamilton, Ontario, Canada.

Insights

Altering Child Behavior Checklist (CBCL) instructions, by adding "never," reduced parent use of the "0" category for child behaviors. This change shifted reporting to the "1" category, impacting prevalence data.

Area of Science:

  • Child psychology
  • Behavioral assessment
  • Psychometric research

Background:

  • The Child Behavior Checklist (CBCL) is a widely used parent-report measure for assessing child behavior problems.
  • Subtle changes in survey instructions can influence participant responses and affect reported prevalence rates.
  • Understanding the impact of wording variations is crucial for accurate behavioral data collection.

Purpose of the Study:

  • To investigate how modifying the instructions for the '0' category (never or not true) on the Child Behavior Checklist affects reported behavior prevalence in children.
  • To assess the impact of adding the word 'never' to the standard 'not true' instruction.

Main Methods:

  • Parents were recruited through convenience sampling and randomly assigned to complete CBCL items.
  • One group received standard instructions ('not true' for the '0' category).
  • The other group received modified instructions ('never or not true' for the '0' category).

Main Results:

  • Adding 'never' to the instructions significantly decreased parents' use of the '0' category.
  • Conversely, the use of the adjacent '1' category (rarely true) increased when 'never' was included.
  • These changes suggest a shift in response patterns due to instruction wording.

Conclusions:

  • Wording in assessment instructions, even minor changes, can influence parent reporting of child behaviors.
  • The findings highlight the sensitivity of the Child Behavior Checklist to instruction modifications.
  • Careful consideration of wording is necessary to ensure the validity and reliability of behavioral prevalence data.

Related Concept Videos

Naturalistic Observations02:30

Naturalistic Observations

If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
Introduction to Epidemiology01:26

Introduction to Epidemiology

Epidemiology, known as the cornerstone of public health, involves studying the distribution and determinants of health-related events in defined populations and applying these insights to control health issues. This is essential for understanding how diseases spread, identifying populations at greater risk, and implementing measures to control or prevent outbreaks. Epidemiology addresses not only infectious diseases but also non-communicable conditions like cancer and cardiovascular disease,...
Study Designs in Epidemiology01:20

Study Designs in Epidemiology

Epidemiological study designs are fundamental tools for investigating the distribution, determinants, and control of health conditions in populations. They help researchers understand the relationships between exposures and outcomes, and they broadly fall into two categories: "observational" and "experimental" studies.
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and case-control studies.
Confounding in Epidemiological Studies01:27

Confounding in Epidemiological Studies

Confounding in statistical epidemiology represents a pivotal challenge, referring to the distortion in the perceived relationship between an exposure and an outcome due to the presence of a third variable, known as a confounder. This variable is associated with both the exposure and the outcome but is not a direct link in their causal chain. Its presence can lead to erroneous interpretations of the exposure's effect, either exaggerating or underestimating the true association. This phenomenon...
Bias in Epidemiological Studies01:29

Bias in Epidemiological Studies

Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
Statistical Methods for Analyzing Epidemiological Data01:25

Statistical Methods for Analyzing Epidemiological Data

Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods: