To observe the observations on observational research: how do Italian online media report about a contemporary
Raffaele Rasoini1, Fabio Ambrosino2, Rebecca De Fiore2
1Associazione Alessandro Liberati - Cochrane Affiliate Centre, Lauria (Potenza).
Background:
The media's key role in conveying health information to the public is not always supported by the quality of the reporting. Despite findings from observational studies (OSs) represent a substantial proportion of media health news, limitations of OSs are often overlooked in medical journals' abstracts, in press releases, and in associated news stories. The objective of this analysis is to investigate how Italian online news media report on a contemporary OS published in a major medical journal and dealing with a topic of widespread interest.
Methods:
The OS was published in Nature Medicine (Nat Med) in February 2022. It is a large retrospective cohort study aimed at characterizing the post-acute cardiovascular manifestations of covid-19. We collected Italian online news articles covering the Nat Med study that were released in the first two weeks after study publication. Based on resources focused on evaluation and proper reporting of OSs, we identified five thematic categories to be employed as a minimal reference standard to address the quality of reporting of the Nat Med study. Namely: 1) causality, 2) fear mongering, 3) spin, 4) actionability and 5) critical evaluation. Then, we defined a 13-item checklist aimed at exploring the existence of issues within each of the online news article with regard to the five thematic categories above. Outcome was the percentage of news articles covering the NM study showing issues with each of the five thematic categories.
Results:
After checking for inclusion and exclusion criteria, we collected 30 news articles. Global inter-rater agreement related to the checklist completion by 4 raters was substantial. An issue with causality was identified in 30 articles out of 30 (100%). An issue with fear mongering was identified in 25 (83.3%) of the 30 articles, and an issue with spin in 21 (75%) of the 28 articles. Furthermore, an issue with actionability and critical evaluation was identified in 16 (53.3%) and 26 (86.7%) of the 30 articles, respectively.
Conclusions:
Our analysis of Italian online news media reporting about a contemporary OS published in a major medical journal and dealing with a topic of high public interest has shown that most news articles fail to properly report on the study's findings.
More Related Videos
Related Concept Videos
Observational Studies
There are three types of observational studies – Prospective, retrospective, and cross-sectional.
Prospective Study
Prospective studies, also known as longitudinal or cohort studies, are carried out by collecting future data from groups sharing similar characteristics. One...
Bias in Epidemiological Studies
Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
Confounding in Epidemiological Studies
Chi-square Analysis
The chi-square test was developed by Pearson in 1990.
The first step of performing a Chi-square analysis is to establish a null hypothesis, which assumes that there is no real...
Naturalistic Observations


