Related Experiment Video
Updated: Nov 27, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
The Predicament of Large Numbers of Observations and How We Got There: Critical Review
1Department of Veteran Affairs Medical Center, Louisville, KY.
Background:
Classical statistics were developed in a time when small sample sizes were the norm; thus, statistical significance typically ensured large clinical effects. Over the past 10-20 years, computational techniques have allowed studies with modest effects to reach statistical significance (usually P < 0.05) by analyzing very large numbers of patients. In this review, I discuss how this came about and provide an intuitive understanding of the strengths and weaknesses of various statistical parameters that provide insight into clinical effect sizes.
Content:
In this review of the literature, a simple web-based program was used for calculations. Examples are shown. Odds and risk ratios are compared with ROC curves to allow better understanding of their predictive value.
Summary:
In these complex times, an intuitive understanding of statistical procedures is increasingly important. This review will attempt to advance the reader's knowledge so that one can calculate the number needed to treat and its confidence interval, understand the meaning of a modest association, and determine when a study is likely to be accurate but with questionable clinical utility.
Related Concept Videos
Detection of Gross Error: The Q Test
Testing a Claim about Population Proportion
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
Naturalistic Observations
Data Collection by Observations
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
Quantifying and Rejecting Outliers: The Grubbs Test
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...

