Searching for reliable relationships with statistics packages: an empirical example of the potential problems
Related Experiment Video
Updated: Oct 17, 2026

Global and Current Research Trends of Single-Cell Sequencing in Cancer: A Bibliometric and Visualization Study
Published on: April 18, 2025
1Department of Psychology, Adams State College, Alamosa, CO 81102, USA. tcrinol@adams.edu
Abstract:
Many social scientists appear to possess an overconfidence in the reliability of research results from a single, small-sample, inferential study. In this article, the authors speculate that "user-friendly" statistics packages have the potential to exacerbate statistical misinterpretation by providing researchers with a tool to explore data easily and identify what is interpreted as "reliable" relationships. This article contains an empirical demonstration of the potential problems that arise when a large number of statistical tests are interpreted. Results show that statistically significant results may be unreliable. Also, a zero relationship can erroneously appear as a medium to large effect size relationship when a small sample is used (e.g., n = 30). The authors suggest the need for multiple replications as the criterion of a reliable finding.
Related Concept Videos
Introduction to R
Statistical Software for Data Analysis and Clinical Trials
Statgraphics
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Statistical Methods for Analyzing Epidemiological Data
Statistical Package for the Social Sciences (SPSS)
SPSS streamlines the process from data preparation to analysis and reporting. It is characterized by its user-friendly interface, which conceals...