Related Experiment Video
Updated: Jun 11, 2026
14:38
Creating Objects and Object Categories for Studying Perception and Perceptual Learning
Published on: November 2, 2012
Comparing simulation and threshold approaches when analysing data with probabilities of categories
Fang Zhang1, J Frank Wharam, Dennis Ross-Degnan
1Department of Ambulatory Care and Prevention, Harvard Medical School and Harvard Pilgrim Health Care, Boston, MA 02215, USA. fang_zhang@hphc.org
Journal of Evaluation in Clinical Practice
|July 1, 2010
Summary
The simulation approach offers more accurate inferences for probability-based data compared to the threshold approach. This method is recommended when analyzing outcomes or exposures, especially when data size permits.
Area of Science:
- Biostatistics
- Health Services Research
- Epidemiology
Background:
- Categorizing data based on probabilities is common in health research.
- Two primary methods for inference include the threshold and simulation approaches.
- Understanding the differences is crucial for accurate analysis.
Purpose of the Study:
- To compare the inferential capabilities of the threshold and simulation approaches.
- To illustrate the practical differences using structured and published health data.
- To determine the preferred method for probability-based data analysis.
Main Methods:
- Utilized a structured example and published datasets.
- Applied both threshold and simulation approaches to analyze health plan effects.
- Compared estimation of incident rate ratios (IRR) for emergency department visits.
Main Results:
- Simulation approach yielded different results than the threshold approach.
- Simulation estimated a statistically significant IRR of 0.78 for non-preventable ED visits.
- Threshold approach (75%) showed no statistical significance (IRR 0.98) for high-severity cases.
- No threshold value replicated the simulation approach's findings.
Conclusions:
- The simulation approach is superior to the threshold approach for probability-based data.
- Preferred for analyzing outcomes, exposures, and covariates when data size is adequate.
- Enhances the accuracy of health economic and epidemiological studies.
Related Concept Videos
01:24Testing a Claim about Population Proportion
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
01:20Comparing the Survival Analysis of Two or More Groups
Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and Cox...
01:19Expected Frequencies in Goodness-of-Fit Tests
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
01:14Decision Making: Traditional Method
The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
01:14Probability in Statistics
Probability is the likelihood of an event occurring. The term event is defined as a collection of results of a procedure. An event is a simple event when an outcome cannot be divided into simpler parts.
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
An example of a simple event is a coin toss. The result of a coin toss is either a head or a tail. Here, head and tail are two simple events. These two simple events make up the sample space. Further, the probability of an event occurring falls within the range of 0 to 1. The probability of an...
01:17Probability Histograms
A probability histogram is a visual representation of a probability distribution. Similar a typical histogram, the probability histogram consists of contiguous (adjoining) boxes. It has both a horizontal axis and a vertical axis. The horizontal axis is labeled with what the data represents. The vertical axis is labeled with probability. Each rectangular bar in the histogram is 1 unit wide, which suggests that the area under each bar equals the probability, P(x), where x is 1, 2, 3, and so on.