Related Experiment Videos
A multi-agent vision-language debate framework for zero-shot crop disease diagnosis
Mustafa Al Juboori1, Zeeshan Abbas2, Zayed Al Aghbari1
1College of Information Technology, United Arab Emirates University, Al-Ain, Abu Dhabi, United Arab Emirates.
Abstract:
Accurate crop disease diagnosis is critical for agricultural productivity and food security, yet existing deep learning systems often struggle to generalize across visually similar diseases and varying environmental conditions. Recent Vision-Language Models (VLMs) have demonstrated promising zero-shot reasoning capabilities; however, most agricultural diagnostic systems still rely on isolated single-model predictions without collaborative reasoning or consensus mechanisms. In this work, we propose VIDA+PANDA, a multi-agent Vision-Language framework for zero-shot crop disease diagnosis. The framework consists of two stages: VIDA, where multiple VLM agents independently analyze crop leaf images to establish baseline performance, and the Peer-Anchored Named Deliberation Architecture (PANDA), which introduces a structured multi-round debate among a selected group of high-performing and architecturally diverse agents. During deliberation, agents exchange reasoning, critique peer predictions, and revise decisions through evidence-grounded discussion, while an anti-sycophancy mechanism discourages unsupported consensus shifts. Final predictions are generated through performance-weighted consensus voting. Experiments are conducted on the CDDM benchmark using seven heterogeneous VLMs from four independent providers, including two open-source models, under a fully zero-shot setting. A non-participant GPT-5 model serves as an independent judge to assess the final diagnostic predictions. Beyond conventional accuracy, the framework introduces three semantic measures: Semantic Label Similarity (SLS), which measures how semantically close a predicted crop-disease pair is to the ground truth and captures partial correctness overlooked by exact-match evaluation; Reasoning Specificity (RS), which measures how concretely an agent's explanation references visual evidence such as lesion color, shape, texture, or margins; and Inter-Agent Reasoning Convergence (IRC), which measures the extent to which agents rely on similar visual evidence, capturing epistemic alignment independently of label correctness. Experimental results show that collaborative multiagent deliberation improves individual diagnostic performance and semantic alignment, with the largest gains observed among weaker participating agents. The findings also reveal important relationships between predictive accuracy, persuasive influence, and consensus formation in VLM-based agricultural diagnosis.