Combined interpretation of objective firearm evidence comparison algorithms using Bayesian networks

Traditionally, firearm and toolmark examiners manually evaluate the similarity of features on two bullets using comparison microscopy. Advances in microscopy have made it possible to collect 3D topographic data, and several automated comparison algorithms have been introduced for the comparison of bullet striae using these data. In this study, open-source approaches for cross-correlation, congruent matching profile segments, consecutive matching striations, and a random forest model were evaluated. A statistical characterization of these automated approaches was performed using four datasets of consecutively manufactured firearms to provide a challenging comparison scenario. Each automated approach was applied to all samples in a pairwise fashion, and classification performance was compared. Based on these findings, a Bayesian network was empirically learned and constructed to leverage the strengths of each individual approach, model the relationship between the automated results, and combine them into a posterior probability for the given comparison. The network was evaluated similarly to the automated approaches, and the results were compared. The developed Bayesian network classified 99.6% of the samples correctly, and the resultant probability distributions were significantly separated more so than the automated approaches when used in isolation.