Insect diversity estimation in polarimetric lidar

Identifying flying insects is a significant challenge for biologists. Entomological lidar offers a unique solution, enabling rapid identification and classification in field settings. No other method can match its speed and efficiency in identifying insects in flight. This non-intrusive tool is invaluable for assessing insect biodiversity, informing conservation planning, and evaluating efforts to address declining insect populations. Although the species richness of co-existing insects can reach tens of thousands, current photonic sensors and lidars can differentiate roughly one hundred signal types. While the retrieved number of clusters correlate with Malaise trap diversity estimates, this taxonomic specificity, the number of discernible signal types is currently limited by instrumentation and algorithm sophistication. In this study, we report 32,533 observations of wild flying insects along a 500-meter transect. We report the benefits of lidar polarization bands for differentiating species and compare the performance of two unsupervised clustering algorithms, namely Hierarchical Cluster Analysis and Gaussian Mixture Model. Our analysis shows that polarimetric properties could be partially predicted even with unpolarized light, thus polarimetric lidar bands provide only a minor improvement in specificity. Finally, we use the physical properties of the clustered observations, such as wing beat frequency, daily activity patterns, and spatial distribution, to establish a lower bound for the number of species represented by the differentiated signal types.