Issues of replicability in Monte Carlo modeling: a case study with a pesticide leaching model

Sensitivity and uncertainty analyses based on Monte Carlo sampling were undertaken for various numbers of runs of the pesticide leaching model (PELMO). Analyses were repeated 10 times with different seed numbers. The ranking of PELMO input parameters according to their influence on predictions for leaching was stable for the most influential parameters. For less influential parameters, the sensitivity ranking was severely influenced by the seed number used. For uncertainty analyses, probabilities of exceeding a particular concentration were significantly influenced by the seed number used in the random sampling of values for the two parameters considered, even for those cases in which 5,000 model runs were undertaken (coefficient of variation of 10 replicated analyses, 5%). A decrease in the variability of exceedance probabilities could be achieved by further increasing the number of model runs. However, this may prove to be impractical when complex deterministic models with a relatively long running time are used. Attention should be paid to replicability aspects by modelers when devising their approach to assessing the uncertainty associated with the modeling and by decision makers when examining the results of probabilistic approaches.