Consolidation of expert ratings of motion artifacts using hierarchical label fusion

Intra-scan motion costs tens of thousands of dollars per scanner annually due to the need to repeat non-diagnostic scans¹. When assessing the scale of the problem and potential solutions, radiologists' ratings of artifacts are considered the gold standard. However, inconsistent and conflicting ratings must be consolidated into a single gold-standard. We introduce a hierarchical label fusion algorithm that infers each rater's performance and promotes consistency across slices from a volume. This algorithm reduces label noise compared to majority votes, and allows non-expert ratings to be calibrated and included as additional silver-standards.