Related Experiment Video
Updated: Aug 23, 2026

An Experimental Analysis of Children's Ability to Provide a False Report about a Crime
Published on: May 3, 2016
Diagnosing estimate distortion due to significance testing in literature on detection of deception
1Department of Psychology, University of New Brunswick, P.O. Box 5050, Saint John, New Brunswick E2L 4L5, Canada.
Abstract:
Studies journals typically report or feature results significant by statistical test criterion. This is a bias that prevents obtaining precise estimates of the magnitude of any underlying effect. It is severe with small effect sizes and small numbers of measurements. To illustrate the problem and a diagnosis technique, results of published studies on the detection of deception are graphed. The literature contains large effect sizes affirming that deceptive responses in contrast to truthful responses are associated with more reactive Skin Resistance Responses. These effect sizes when graphed on the x-axis against n on the y-axis are distributed as funnel graphs. A subset of studies show support for predicted small to medium effects on different physiological measures, individual differences, and condition manipulations. These effect sizes graphed by sample ns follow negative correlations, suggesting that effect sizes from published values of t, F, and zeta are exaggerations.
Related Concept Videos
Understanding Deception
Significance Testing: Overview
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Statistical Significance
Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in value between...
Decision Making: Traditional Method
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
