Perceptions of conflict of interest disclosures among peer reviewers

Disclosure of financial conflicts of interest (COI) is intended to help reviewers assess the impact of potential bias on the validity of research results; however, there have been no empiric assessments of how reviewers understand and use disclosures in article evaluation. We investigate reviewers' perceptions of potential bias introduced by particular author disclosures, and whether reviewer characteristics are associated with a greater likelihood of perceiving bias.

Of the 911 active reviewers from the Annals of Emergency Medicine, 410 were randomly selected and invited to complete our web-based, 3-part survey. We completed descriptive analysis of all survey responses and compared those responses across reviewer characteristics using 2 × 2 analyses and the Fisher exact test. We had a response rate of 54%. The majority of reviewers surveyed reported a high level of skepticism regarding financial relationships between authors and industry without a clear or consistent translation of that skepticism into the self-reported actions that characterize manuscript assessment. Only 13% of respondents believed physician consultants authoring articles based on company data are likely to have unlimited data access. 54% believed that bias most likely exists with any honorarium, regardless of monetary amount. Between 46% and 64%, depending on the type of financial relationship disclosed, reported that their recommendation for publication remains unchanged. Respondents reporting personal financial ties to industry were less likely to perceive bias in industry relationships and less likely to believe that bias exists with any monetary amount of honoraria.

We recommend that the monetary amount of all financial relationships be reported with manuscript submissions, lead authors certify that they have unrestricted access to data, and reviewers disclose any financial ties to industry whether or not they are related to the manuscript under review. Further research is required to better understand reviewers' perceptions of financial relationships between authors and industry in order to develop clear and consistent guidelines for incorporating the perception of potential bias into manuscript assessments.