A vector space method to quantify agreement in qualitative data
Related Experiment Video
Updated: Jun 28, 2026

Quantification of Orofacial Phenotypes in Xenopus
Published on: November 6, 2014
Delano J McFarlane1, Jessica S Ancker, Rita Kukafka
1Departments of Biomedical Informatics (DJM, JSA, RK) and Sociomedical Sciences (RK)Columbia University, New York, NY, USA.
Abstract:
Interrater agreement in qualitative research is rarely quantified. We present a new method for assessing interrater agreement in the coding of focus group transcripts, based on vector space methods. We also demonstrate similarities between this vector method and two previously published interrater agreement methods. Using these methods, we showed that interrater agreement for the qualitative data was quite low, attributable in part to the subjective nature of the codes and in part to the very large number of possible codes. These methods of assessing interrater agreement have the potential to be useful in determining and improving reliability of qualitative codings.
Related Concept Videos
Qualitative Analysis
For instance, group IV...
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Introduction to Vectors
Introduction to Vectors
Vectors
Cartesian Vector Notation

