The development of a Weighted Objective Research Criterion Assessment Tool (WORCAT)

The aim of this study was to develop an instrument to evaluate research reports objectively according to set criteria, relative weights and critical errors. A tentative instrument was compiled and copies were sent to 144 university lecturers and senior lecturers at South African Nursing Science Departments in order to determine: the face validity of the assessment criteria of the 18 stated aspects of research reports, the weight or relative value of each of the aspects, how relationships between aspects should be evaluated. The relative value of each of the 18 aspects was determined by completing a matrix on which aspects were compared. The Analytic Hierarchical Procedure was used to determine the weight of each aspect. The WORCAT was developed from the findings and the most striking feature is the high relative weight allocated to each of the following aspects of research reports: recommendations = 20%; conclusions = 10%; literature study = 10%; problem statement = 7%. The reliability of the WORCAT still needs to be tested.