New recommender system evaluation approaches based on user selections factor

Currently, due to the increasing importance of recommender systems (RSs), especially in the fields of social networking and e-commerce, these systems represent one of the most interesting subjects in computer programming. Although many research reports have previously been published in this subject area, because of lack of clarity regarding their algorithms or limited comparisons with the literature, most of them are difficult to extend for similar applications in the future. Therefore, in the present study, we have attempted to improve two novel RS evaluation measures (variety and newness) developed from previous evaluator rules (namely, diversity and novelty) based on human behavior so as to be more reliable and compatible with various developments in RSs. The new rules provide higher weighting for suggestions and respect for users' behavior and can be used in place of diversity and novelty rules with better precision and centralization, by 22.54% for variety and by 14.84% for newness. In addition, we aim to use the developed measures to improve new RSs and support better comparative analyses in this field in the future. This contribution is expected to facilitate better RS research and competition, especially in the social networking domain.