Design, development and validation of a system for automatic help to medical text understanding

The paper presents a web-based application, SIMPLE, that facilitates medical text comprehension by identifying the health-related terms of a medical text and providing the corresponding consumer terms and explanations.

The comprehension of a medical text is often a difficult task for laypeople because it requires semantic abilities that can differ from a person to another, depending on his/her health-literacy level. Some systems have been developed for facilitating the comprehension of medical texts through text simplification, either syntactical or lexical. The ones dealing with lexical simplification usually replace the original text and do not provide additional information. We have developed a system that provides the consumer terms alongside the original medical terms and also adds consumer explanations. Moreover, differently from other solutions, our system works with multiple languages.

We have developed the SIMPLE application that is able to automatically: 1) identify medical terms in a medical text by using medical vocabularies; 2) translate the medical terms into consumer terms through medical-consumer thesauri; 3) provide term explanations by using health-consumer dictionaries. SIMPLE can be used as a standalone web application or can it be embedded into common health platforms for real time identification and explanation of medical terms. At present, it works with English and Italian texts but it can be easily extended to other languages. We have run subjective tests with both medical experts and non-experts as well as objective tests to verify the effectiveness of SIMPLE and its simplicity of use.

Non-experts found SIMPLE easy to use and responsive. The big majority of respondents confirmed they were helped by SIMPLE in understanding medical texts and declared their willingness to continue using SIMPLE and to recommend it to other people. The subjective tests, conducted with medical experts on a set of Italian radiology reports, showed an agreement between SIMPLE and the experts, on the highlighted medical terms, that ranges between 74.05 % and 81.16 % as well as an agreement of around 60 % on the consumer term translation. The objective tests showed that the consumer terms, provided by SIMPLE, are, on average, eighteen times more familiar than the relative medical terms so proving, once more, the effectiveness of SIMPLE in simplifying the medical terms.

The performed tests demonstrate the effectiveness of SIMPLE, its simplicity of use and the willingness of people in continuing with its use. SIMPLE provides, with a good agreement level, the same information that medical experts would provide. Finally, the consumer terms are 'objectively' more familiar than the related technical terms and as a consequence, much easier to understand.