Related Experiment Video
Updated: Aug 21, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
An approach to knowledge base construction based on expert opinions
J F van Ast1, J L Talmon, W O Renier
1Department of Medical Informatics, University of Maastricht, Maastricht, The Netherlands. w.vanast@mi.unimaas.nl
Objectives:
To describe, validate and demonstrate an approach for knowledge base construction based on expert opinions.
Methods:
A knowledge base containing the frequency of occurrence of manifestations in epileptic seizures is constructed based on information provided by neurologists/epileptologists. The reliability of the responses is determined with the inter-rater intraclass correlation coefficient (ICC). If the ICC is not large enough the Spearman-Brown prophecy formula can be used to predict the number of additional experts. We propose a method to assess whether an additional expert provides information consistent with the already acquired data as well as a method to detect experts with deviating opinions. The power of the first method was determined.
Results:
Data were collected for five seizure types. The ICCs determined from the responses for the various seizure types after inclusion of the additional experts was in all cases almost equal to 0.9, the target value. Yet one expert with diverging opinions concerning the frequency of occurrence of manifestations for different seizure types could be identified. Excluding this participant improved the reliability of the data. The power of the methods was good (> or =0.75).
Conclusions:
It is shown that human experts can provide reliable information about the frequency of occurrence of manifestations in epileptic seizures. In addition, the described approach correctly identified neurologists/epileptologists with both consistent and diverging opinions about the frequency of occurrence of manifestations in a number of seizure types.
Related Concept Videos
Inductive Reasoning
Weak Base Solutions
The Nativist Approach
Accuracy, limits, and approximation
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...
Deductive Reasoning
The Representativeness Heuristic