Drones for litter mapping: An inter-operator concordance test in marking beached items on aerial images

Unmanned aerial systems (UAS, aka drones) are being used to map macro-litter on the environment. Sixteen qualified researchers (operators), with different expertise and nationalities, were invited to identify, mark and categorize the litter items (manual image screening, MS) on three UAS images collected at two beaches. The coefficient of concordance (W) among operators varied between 0.5 and 0.7, depending on the litter parameter (type, material and colour) considered. Highest agreement was obtained for the type of items marked on the highest resolution image, among experts in litter surveys (W = 0.86), and within territorial subgroups (W = 0.85). Therefore, for a detailed categorization of litter on the environment, the MS should be performed by experienced and local operators, familiar with the most common type of litter present in the target area. This work provides insights for future operational improvements and optimizations of UAS-based images analysis to survey environmental pollution.