From Images to Loci: Applying 3D Deep Learning to Enable Multivariate and Multitemporal Digital Phenotyping and...

The selection and promotion of high-yielding and nitrogen-efficient wheat varieties can reduce nitrogen fertilizer application while ensuring wheat yield and quality and contribute to the sustainable development of agriculture; thus, the mining and localization of nitrogen use efficiency (NUE) genes is particularly important, but the localization of NUE genes requires a large amount of phenotypic data support. In view of this, we propose the use of low-altitude aerial photography to acquire field images at a large scale, generate 3-dimensional (3D) point clouds and multispectral images of wheat plots, propose a wheat 3D plot segmentation dataset, quantify the plot canopy height via combination with PointNet++, and generate 4 nitrogen utilization-related vegetation indices via index calculations. Six height-related and 24 vegetation-index-related dynamic digital phenotypes were extracted from the digital phenotypes collected at different time points and fitted to generate dynamic curves. We applied height-derived dynamic numerical phenotypes to genome-wide association studies of 160 wheat cultivars (660,000 single-nucleotide polymorphisms) and found that we were able to locate reliable loci associated with height and NUE, some of which were consistent with published studies. Finally, dynamic phenotypes derived from plant indices can also be applied to genome-wide association studies and ultimately locate NUE- and growth-related loci. In conclusion, we believe that our work demonstrates valuable advances in 3D digital dynamic phenotyping for locating genes for NUE in wheat and provides breeders with accurate phenotypic data for the selection and breeding of nitrogen-efficient wheat varieties.