Related Experiment Video
Updated: Sep 26, 2026

A User-friendly and Powerful R Analysis of Large-scale Datasets
Published on: November 4, 2025
Sample size calculator for reliability and validity evaluation: a Shiny R application
Macy Glover1, Xi Chen1, Joseph C Cappelleri2
1Department of Biostatistics & Data Science, University of Kansas Medical Center, Kansas City, KS, USA.
Objectives:
The objective is to provide a user-friendly tool for researchers to compute sample sizes for studies involving psychometric reliability and validity metrics.
Methods:
The application was developed using R Shiny to create an interactive interface to calculate sample sizes for reliability, validity, and group difference assessments. For metrics already included in existing tools, cross-validation was performed to ensure consistency and accuracy. For metrics unique to this app, validation was based on formulas from the original publications.
Results:
A comprehensive set of sample size calculation modules was included, covering Pearson correlation, Spearman correlation, tetrachoric correlation, point-biserial correlation, Cohen's kappa, Fleiss' kappa, Cronbach's alpha, intraclass correlation coefficient, Kendall's coefficient of concordance, one-way analysis of variance, and one-way analysis of covariance. Researchers can access detailed outputs, including sample sizes, contextual interpretations, and step-by-step derivations of the results, ensuring transparency and usability.
Conclusions:
The Sample Size Calculator is a validated and helpful resource for researchers seeking to optimize study design. The calculator can be accessed at the following website: https://biostats-shinyr.kumc.edu/PsychometricN/.
Related Concept Videos
Introduction to R
Sample Size Calculation
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
Statistical Software for Data Analysis and Clinical Trials
Interpreting R Charts
An R chart plots the range of subsets of measurements collected from a process. Each point on the chart represents the range—defined as the difference between the maximum and minimum values—of a sample...
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
Overview of Minitab

