Automatic Microplot Localization Using UAV Images and a Hierarchical Image-Based Optimization Method

To develop new crop varieties and monitor plant growth, health, and traits, automated analysis of aerial crop images is an attractive alternative to time-consuming manual inspection. To perform per-microplot phenotypic analysis, localizing and detecting individual microplots in an orthomosaic image of a field are major steps. Our algorithm uses an automatic initialization of the known field layout over the orthomosaic images in roughly the right position. Since the orthomosaic images are stitched from a large number of smaller images, there can be distortion causing microplot rows not to be entirely straight and the automatic initialization to not correctly position every microplot. To overcome this, we have developed a three-level hierarchical optimization method. First, the initial bounding box position is optimized using an objective function that maximizes the level of vegetation inside the area. Then, columns of microplots are repositioned, constrained by their expected spacing. Finally, the position of microplots is adjusted individually using an objective function that simultaneously maximizes the area of the microplot overlapping vegetation, minimizes spacing variance between microplots, and maximizes each microplot's alignment relative to other microplots in the same row and column. The orthomosaics used in this study were obtained from multiple dates of canola and wheat breeding trials. The algorithm was able to detect 99.7% of microplots for canola and 99% for wheat. The automatically segmented microplots were compared to ground truth segmentations, resulting in an average DSC of 91.2% and 89.6% across all microplots and orthomosaics in the canola and wheat datasets.