A framework for epistemological analysis in empirical (laboratory and field) studies

In their search for generalizable behavioral patterns and design principles, cognitive field researchers should reflect on the epistemological limitations of empirical studies. In this paper we describe a framework for epistemological analysis that can help serve this purpose and discuss its application to two prototypical cases of cognitive engineering research: laboratory experiments and field studies. The framework examines two, often implicit, processes in empirical research: the abstraction from empirical data and the substantiation of theoretical constructs and principles. By explicitly considering these two processes in several systematic steps, we can gain appreciation for the epistemological contribution of empirical studies to cognitive engineering research. The framework and its application also provide guidance to such important issues as generalizability of results and external validity. Possible applications of this research include providing guidance to researchers and practitioners in evaluating design principles or conducting field studies.