Related Experiment Video
Updated: Jun 26, 2026
RGB and Spectral Root Imaging for Plant Phenotyping and Physiological Research: Experimental Setup and Imaging Protocols
Published on: August 8, 2017
Multimodal learning on RGB-D image for precise litchi phenotyping and weight estimation.
Mingchao Yang1, Riyao Chen2, Ding Chen1
1Institute of Tropical Fruit Trees, Hainan Academy of Agricultural Sciences, Key Laboratory of Genetic Resources and Utilization of Tropical Fruits and Vegetables (Co-construction by Ministry and Province), Key Laboratory of Tropical Fruit Tree Biology of Hainan Province, Investigation Station of Tropical Fruit Trees of Ministry of Agriculture, Haikou, 571100, People's Republic of China.
LitchiPhenoNet, a new AI tool, accurately measures litchi fruit traits like diameter and weight. This automated phenotyping advances litchi breeding by overcoming manual measurement challenges.
Area of Science:
- Agricultural Science
- Computer Vision
- Plant Breeding
Background:
- Accurate litchi phenotyping is crucial for cultivar selection and breeding research.
- Manual measurements are time-consuming, subjective, and inefficient.
- Litchi's complex fruit surface and seed morphology pose challenges for automated analysis.
Purpose of the Study:
- To develop an automated, precise phenotyping tool for litchi fruit traits.
- To address the difficulties in semantic segmentation and estimation caused by litchi's unique characteristics.
- To improve the efficiency and objectivity of litchi breeding programs.
Main Methods:
- Developed LitchiPhenoNet, a multimodal deep learning framework using RGB and depth data.
- Employed a dual-branch architecture with an RD-Fusion module for cross-modal feature extraction.
- Utilized an RGB-D dataset of 1,198 litchi image pairs across 10 cultivars.
Main Results:
- LitchiPhenoNet achieved millimeter-level diameter estimation (R² ≈ 0.98, ME < 2mm), outperforming YOLO models.
- Gram-level precision was obtained for whole fruit, pit, and pulp weight estimation (R² up to 0.98).
- The framework demonstrated robustness against complex pericarp surfaces and cross-cultivar variability.
Conclusions:
- LitchiPhenoNet offers an efficient, reliable, and accurate solution for litchi phenotypic trait quantification.
- The framework enhances objectivity and efficiency in litchi breeding and selection.
- The approach is extensible to other textured fruits and scalable for high-throughput phenotyping.
