Evaluating risk of bias using ROBINS-I tool in nonrandomized studies of adjuvanted influenza vaccine

Seasonal variation in influenza vaccine effectiveness (VE) makes real-world evidence (RWE) useful in supplementing the clinical-evidence base from randomized clinical trials. Adjuvanted inactivated influenza vaccine (aIIV) VE has been evaluated in multiple nonrandomized RWE studies. A systematic literature review of RWE studies evaluating the absolute or relative VE of aIIV was conducted. Identified studies were assessed by evaluators for risk of bias (RoB) by means of the ROBINS-I (Reduction of Bias In Non-randomized Studies of Interventions) tool to inform evidence-based medicine deliberations. Differences in evaluator assessments were resolved by consensus. The literature review yielded 14 follow-up studies, seven test-negative case-control (TNCC) studies, five traditional case-control studies, and one cluster-randomized clinical trial. Most follow-up studies and three TNCC studies were judged at low RoB. Issues increasing RoB included inadequate control of confounding, selection of controls, and reliance on recall of vaccination. The concerns identified in any of the designs could be mitigated with straightforward revisions to design or implementation. 17 of 27 nonrandomized studies of adjuvanted influenza-vaccine effectiveness, some from each of four study designs, were judged at low risk of material bias. These studies merit credence in assessing aIIV effectiveness relative to other influenza vaccines.