FREGEX: A Feature Extraction Method for Biomedical Text Classification using Regular Expressions

In this work, we present FREGEX a method for automatically extracting features from biomedical texts based on regular expressions. Using Smith-Waterman and Needleman-Wunsch sequence alignment algorithms, tokens were extracted from biomedical texts and represented by common patterns. Three manually annotated datasets with information on obesity, obesity types, and smoking habits were used to evaluate the effectiveness of the proposed method. Features extracted using consecutive sequences of tokens (n-grams) were used for comparison, and both types of features were mathematically represented using the TF-IDF vector model. Support Vector Machine and Naïve Bayes classifiers were trained, and their performances were ultimately used to assess the ability of the feature extraction methods. Results indicate that features based on regular expressions not only improved the performance of both classifiers in all datasets but also use fewer features than n-grams, especially in those datasets containing information related to anthropometric measures (obesity and obesity types).