Related Experiment Video
Updated: Jul 29, 2025

A Method for Quantifying Foliage-Dwelling Arthropods
Published on: October 20, 2019
Getting the bugs out of AI: Advancing ecological research on arthropods through computer vision
Stefan Schneider1, Graham W Taylor2, Stefan C Kremer3
1Computer Science, University of Guelph, Guelph, Ontario, Canada.
Abstract:
Deep learning for computer vision has shown promising results in the field of entomology, however, there still remains untapped potential. Deep learning performance is enabled primarily by large quantities of annotated data which, outside of rare circumstances, are limited in ecological studies. Currently, to utilize deep learning systems, ecologists undergo extensive data collection efforts, or limit their problem to niche tasks. These solutions do not scale to region agnostic models. However, there are solutions that employ data augmentation, simulators, generative models, and self-supervised learning that can supplement limited labelled data. Here, we highlight the success of deep learning for computer vision within entomology, discuss data collection efforts, provide methodologies for optimizing learning from limited annotations, and conclude with practical guidelines for how to achieve a foundation model for entomology capable of accessible automated ecological monitoring on a global scale.

