Risk of Bias Assessment in Non-Randomized Studies of Interventions for Premenstrual Syndrome: A Systematic Review

Objective: Premenstrual syndrome (PMS) is a very prevalent condition that affects premenopausal women and can result in monthly debilitating emotional and physical symptoms. The objective of this systematic review was to determine which predictive factors were associated with an increased amount of bias in non-randomized studies (NRSs) of PMS. Materials and methods: A search of the EMBASE and Medline electronic databases was completed from January 1, 2010 to December 2021. The methodological quality of the included studies was independently evaluated and critically appraised using the Risk of Bias in Non-Randomized Studies - of Interventions (ROBINS-1) tool. Associations of different factors with the risk of bias levels were assessed using a univariate logistic regression. Odds ratio and 95% confidence interval (CI) were reported. Results: Of the 1668 studies, 38 were determined to be eligible for inclusion. The ROBINS-1 tool identified that 12 studies were of low/moderate risk of bias (31.6%) and 26 were of serious/critical risk (68.4%). Evidence of relationships between the ROBINS-1 score and impact factor (OR=0.20; 95% CI, 0.07 to 0.57; p= 0.003) and number of authors (OR=0.65; 95% CI, 0.43 to 0.99; p= 0.046) were identified, whereas no relationships were found with the number of citations, the sample size, the funding type, or the conflict-of-interest statement. Conclusion: The systematic review concludes that the methodological rigor of non-randomized studies of PMS can vary, with fewer authors and a lower impact factor showing evidence of association with a decreased quality of evidence.