The analysis and interpretation of experiments: some philosophical issues

The epistemology and ontology of experimentation are discussed in depth with special reference to biology and medicine. Two types of experiments are distinguished: exploratory (or "blazing") and consolidating. They have objectives and canons that are strikingly different. A contrast is drawn between the literalism of the most pragmatic scientists and the formalism of most statisticians. The terms and notions of the one may have imperfect correspondence with those of the other, or perhaps none at all. The dangers are pointed out of both the conclusion that the gap between the two is unbridgeable and the contrary view that the gap is trivial and merits no serious attention. Substantive discussions address the choice and meaning of a metric, the idea of interaction and time series analysis, the ontology of variation, and the epistemology of randomization, hypothesis-seeking, and multiple comparisons.