An 11-Year (2012-2022) review of Journal of Athletic Training publication study designs and sample sizes

Research findings must be representative by creating a sample of individuals, ensuring the results can be generalized and applicable to a larger population, which has historically been guided by a power analysis. However, the varied research design methods require a unique approach to sampling and a formula for recruitment and size. Therefore, the purpose of this study was to analyze historical data from published manuscripts in the Journal of Athletic Training (JAT) relative to study design and sample sizes. A secondary purpose was to further explore metrics for survey-based research.

This descriptive analysis explored 1267 publications in each issue of the JAT from January 2012 (Volume 47) to December 2022 (Volume 57). We extracted publications from the JAT website. Every article was entered into a spreadsheet (year of publication, publication title) and data specific to the study design and sample size were used for analysis. For studies that were coded as survey-based research, access, response, and completion rates were completed, and topic area and use of a power analysis were extracted. Data were analyzed using measures of central tendency (mean, median, range).

Of the 1267 published studies, the most frequent design was cross-sectional (394, 31.1%). In total, 1080 publications (85.2%) were not survey-based, with a median sample size of 34 participants, while 187 publications (14.8%) were survey-based, with a median sample size of 429. Among those surveys, most were cross-sectional (n = 151/187, 80.8%), with 80.7% (n = 151/187) reporting the number initially recruited and 50.8% (n = 95/187) reporting the number of surveys started. The survey publications reported recruiting an average of 4453 potential participants (median = 2500; min = 101, max = 48752), with 985 participants starting the study (median = 816, min = 57, max = 7067), and a final sample size of 819 (median = 429; min = 17, max = 13002). The grand mean access rate was 22.1%, the grand mean response rate was 18.4%, and the grand mean completion rate was 83.1%.

Researchers and reviewers can use these trends to guide authorship and review processes for athletic training research. However, sampling strategies should be consistent with the research question, which may lead to deviations from these reported trends.