Microbial biodiversity: approaches to experimental design and hypothesis testing in primary scientific literature...

Research interest in microbial biodiversity over the past 25 years has increased markedly as microbiologists have become interested in the significance of biodiversity for ecological processes and as the industrial, medical, and agricultural applications of this diversity have evolved. One major challenge for studies of microbial habitats is how to account for the diversity of extremely large and heterogeneous populations with samples that represent only a very small fraction of these populations. This review presents an analysis of the way in which the field of microbial biodiversity has exploited sampling, experimental design, and the process of hypothesis testing to meet this challenge. This review is based on a systematic analysis of 753 publications randomly sampled from the primary scientific literature from 1975 to 1999 concerning the microbial biodiversity of eight habitats related to water, soil, plants, and food. These publications illustrate a dominant and growing interest in questions concerning the effect of specific environmental factors on microbial biodiversity, the spatial and temporal heterogeneity of this biodiversity, and quantitative measures of population structure for most of the habitats covered here. Nevertheless, our analysis reveals that descriptions of sampling strategies or other information concerning the representativeness of the sample are often missing from publications, that there is very limited use of statistical tests of hypotheses, and that only a very few publications report the results of multiple independent tests of hypotheses. Examples are cited of different approaches and constraints to experimental design and hypothesis testing in studies of microbial biodiversity. To prompt a more rigorous approach to unambiguous evaluation of the impact of microbial biodiversity on ecological processes, we present guidelines for reporting information about experimental design, sampling strategies, and analyses of results in publications concerning microbial biodiversity.