Factors Associated With Altmetric Attention Scores for Randomized Phase III Cancer Clinical Trials

Altmetric Attention Scores (Altmetrics) are real-time measures of scientific impact and attention through various public outlets, including news, blogs, and social media. Herein, we aimed to describe and characterize the relationship between Altmetrics, conventional impact metrics, and features of published cancer clinical trials.

We identified two-arm phase III cancer randomized clinical trials with a superiority end point and publication date between 2015 and 2020 from HemOnc and tabulated the following data: Altmetric, study positivity, US Food and Drug Administration (FDA) registration trial status, cancer site/category, treatment context (curative or palliative), trial design, primary end point type, experimental/control arm modality, and journal tier. We further collected conventional bibliometrics including the number of citations and relative citation ratio (RCR) for all published studies. Multiple linear regression modeling identified clinical trial factors predictive of Altmetrics, with alpha = .05 defining statistical significance.

Altmetrics were found for 681 (98%) of 698 publications, with a median score of 38.5 (IQR, 13-132.8). FDA registration studies (β [95% CI], 84.7 [48.8 to 120.6]; P < .001), studies reporting on curative (as opposed to palliative) interventions (-29 [-53.7 to -4.4]; P = .02), genitourinary trials (73.2 [28.1 to 118.2]; P = .001), studies published in tier 1 journals (P < .001), and those with an increased number of citations per year (0.81 [0.66 to 0.95]; P < .001) were significantly associated with increased engagement as measured by Altmetrics. Furthermore, there was a strong correlation between all collected bibliometrics and Altmetrics (R² = 0.63, 0.68, and 0.67; P < .001 for citation count, citations per year, and RCR, respectively).

FDA registration trials describing curative interventions, studies published in traditionally defined high-impact journals, and genitourinary trial publications tend to have the greatest Altmetrics. We observed a strong relationship between Altmetrics and conventional bibliometrics. The significance and consequences of these relationships warrant further investigation.