Subjective logic as a complementary tool to meta-analysis to explicitly address second-order uncertainty in research...

Any experiment brings about results and conclusions that necessarily have a component of uncertainty. Many factors influence the degree of this uncertainty, yet they can be overlooked when drawing conclusions from a body of research. Here, we showcase how subjective logic could be employed as a complementary tool to meta-analysis to incorporate the chosen sources of uncertainty into the answer that researchers seek to provide to their research question. We illustrate this approach by focusing on a body of research already meta-analyzed, whose overall aim was to assess if human infants prefer prosocial agents over antisocial agents. We show how each finding can be encoded as a subjective opinion, and how findings can be aggregated to produce an answer that explicitly incorporates uncertainty. We argue that a core feature and strength of this approach is its transparency in the process of factoring in uncertainty and reasoning about research findings. Subjective logic promises to be a powerful complementary tool to incorporate uncertainty explicitly and transparently in the evaluation of research.