Improving access to COVID-19 information by ensuring the readability of government websites

This study evaluated the readability of web pages from two public-facing Victorian government websites that were responsible for communicating key health messages relating to the COVID-19 pandemic in 2020.

Webpages were downloaded and filtered to identify relevant materials (English language materials containing HTML files that referred to COVID-19). The files were converted to text files and two Python packages, SpaCy and TextStat were used to obtain the data presented here. In addition to running two well-established readability tests, SMOG Index (Simple Measure of Gobbledygook) and Flesch Reading Ease formula, we also calculated the figures for sentence length and word length, which drive the readability measures and allow a disaggregated view of the data. Type token ratio measures were conducted as a reflection of the breadth of vocabulary used in the web pages.

Derived measures of text complexity were higher than recommended levels of text complexity for health promotion materials, which are generally set at senior primary school levels. This did not vary depending on the intended audience (public or professional). A senior secondary reading level was required for effective engagement with the text published on both sites.

Improving the readability of materials on key government websites where information about COVID-19 is being communicated to the public, represents a low cost and potentially effective means of improving public understanding of the pandemic and the steps individuals need to take to protect themselves and the community. SO WHAT?: Given the challenges widely identified in ensuring compliance with protective behaviours, confidence in seeking vaccination and increasing distrust of government, it would be strategic to improve public communication to ensure health messages are simple and readily understood.

The complexity and readability of text contained in web pages during 2020 from two Victorian government departments were evaluated. Communication regarding the restrictions and the management of risks associated with COVID-19 was the main focus of these 367 individual web pages from the Department of Health and Human Services (DHHS) and the Department of Education and Training (DET). Results indicated that across both sites and on both readability measures used, an education level equivalent to senior secondary school would be required to readily understand the contents.