Shrinkage observed-to-expected ratios for robust and transparent large-scale pattern discovery

G Niklas Norén1, Johan Hopstadius, Andrew Bate

  • 1Uppsala Monitoring Centre, WHO Collaborating Centre for International Drug Monitoring, Uppsala, Sweden. niklas.noren@who-umc.org

Summary

The observed-to-expected (OE) ratio offers a powerful method for discovering real-world patterns in large datasets. Statistical shrinkage enhances this ratio, improving reliability and protecting against false findings in medical research.

Related Concept Videos

Drying Shrinkage01:21

Drying Shrinkage

When hardened concrete is exposed to air with a relative humidity of less than 100 percent, it begins to lose the free water within its capillaries. As this water evaporates, the water initially adsorbed onto the calcium silicate hydrates migrates towards these now empty spaces and eventually evaporates as well. Over time, as more water leaves, the volume of the concrete decreases, a phenomenon known as drying shrinkage.
A portion of this drying shrinkage can be reversed; if the concrete is...
Shrinkage in Concrete01:27

Shrinkage in Concrete

Shrinkage in concrete is primarily due to water loss from evaporation, hydration of cement, or carbonation, leading to a reduction in volume. The volumetric contraction results in volumetric strain in concrete. However, in practice, shrinkage is measured as linear strain, which is one-third of the volumetric strain.
When concrete is still in its plastic state, it can undergo a decrease in volume by about 1% of its absolute volume. This decrease is known as plastic shrinkage. It arises either...
Pore Size Distribution01:23

Pore Size Distribution

In concrete, the pore size distribution significantly influences the material's properties. Capillary pores, markedly larger than gel pores, form a vast network within partially hydrated cement paste, reducing the concrete's strength and increasing its permeability. This heightened permeability leads to a greater risk of damage from environmental factors like freeze-thaw cycles and chemical attacks, with the extent of vulnerability also being tied to the water-to-cement ratio.
Adequate...
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
Survival Tree01:19

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
 Building a Survival Tree
Constructing a survival tree begins...