Relative risk of a shuffled deck: a generalizable logical consistency criterion for sample selection in health state

Benjamin M Craig1, Sulabha Ramachandran

  • 1University of Arizona College of Pharmacy, Tucson, AZ 85721, USA. craig@pharmacy.arizona.edu

Health Economics
|March 15, 2006
PubMed

Insights

Respondents in health state valuation studies can provide inconsistent rankings. A new statistical criterion identifies and removes "shuffled decks" to ensure accurate health valuation estimates.

Area of Science:

  • Health Economics
  • Biostatistics
  • Psychometrics

Background:

  • Health state valuation studies involve respondents ranking health states.
  • Logical inconsistencies can arise, particularly with 'shuffled decks' of cards.
  • Inconsistent responses can bias valuation estimates.

Purpose of the Study:

  • To introduce a novel statistical criterion for identifying and excluding logically inconsistent responses in health state valuation.
  • To ensure the integrity and accuracy of health state valuation estimates.
  • To provide a generalizable method applicable across various health state classifications and valuation techniques.

Main Methods:

  • Development of a logical consistency criterion based on the relative risk of a shuffled deck.
  • Application of the criterion to secondary data from 4048 US and 3395 UK respondents.
  • Utilized time trade-off and visual analog scale techniques for evaluating EQ-5D health states.

Main Results:

  • A small proportion of respondents (approx. 5% in the UK) exhibited shuffled decks.
  • Exclusion of these respondents significantly altered sample characteristics.
  • Mean value estimates for EQ-5D health states were notably impacted by the exclusion.

Conclusions:

  • The proposed logical consistency criterion is effective in identifying problematic respondents.
  • Excluding respondents with shuffled decks is crucial for unbiased health state valuation.
  • The criterion offers a robust method for improving the quality of health valuation data.

Related Concept Videos

Randomized Experiments01:13

Randomized Experiments

The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Relative Risk01:12

Relative Risk

Relative risk (RR) is a statistical measure commonly used in epidemiology to compare the likelihood of a particular event occurring between two groups. This metric is important for evaluating the relationship between exposure to a specific risk factor and the probability of a particular outcome. It plays a crucial role in medical research, public health studies, and risk assessment. Relative risk quantifies how much more (or less) likely an event is to occur in an exposed group compared to an...
Random Sampling Method01:09

Random Sampling Method

Sampling is a technique to select a portion (or subset) of the larger population and study that portion (the sample) to gain information about the population. Data are the result of sampling from a population. The sampling method ensures that samples are drawn without bias and accurately represent the population. Because measuring the entire population in a study is not practical, researchers use samples to represent the population of interest. Among the various sampling methods used by...
Bias01:22

Bias

Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Testing a Claim about Population Proportion01:24

Testing a Claim about Population Proportion

A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...