Positive outcome reporting in orthopaedic literature
Peter Filtes1, Keenan Sobol2, Charles Lin3
1Rutgers Robert Wood Johnson Medical School, Piscataway, New Jersey, USA.
Aims:
Perthes' disease (PD) is a relatively rare syndrome of idiopathic osteonecrosis of the proximal femoral epiphysis. Treatment for Perthes' disease is controversial due to the many options available, with no clear superiority of one treatment over another. Despite having few evidence-based approaches, many patients with Perthes' disease are managed surgically. Positive outcome reporting, defined as reporting a study variable producing statistically significant positive (beneficial) results, is a phenomenon that can be considered a proxy for the strength of science. This study aims to conduct a systematic literature review with the hypothesis that positive outcome reporting is frequent in studies on the treatment of Perthes' disease.
Methods:
We conducted a systematic review of all available abstracts associated with manuscripts in English or with English translation between January 2000 and December 2021, dealing with the treatment of Perthes' disease. Data collection included various study characteristics, surgical versus non-surgical management, treatment modality, mean follow-up time, analysis methods, and clinical recommendations.
Results:
Our study included 130 manuscripts. Overall, 110 (85%) reported positive (beneficial) results, three (2%) reported negative results, and 17 (13%) reported no significant difference. Despite only 10/130 studies (8%) having a testable hypothesis, 71 (55%) recommended the use of their studied treatment methods for the patients, five (4%) made recommendations against the use of the studied treatment modality, and 54 (42%) did not make any recommendations.
Conclusion:
The overall rate for positive outcomes among included manuscripts regarding different treatment methods for Perthes' disease (85%) is higher than the 74% positive outcome rate found among studies for other surgically treated disorders and significantly higher than most scientific literature. Despite the lack of testable hypotheses, most manuscripts recommended their studied treatment method as a successful option for managing patients solely based on the reporting of retrospective data.
