Related Experiment Video
Updated: Aug 18, 2025

Using Learning Outcome Measures to assess Doctoral Nursing Education
Published on: June 21, 2010
Metric indicators for the evaluation of graduate programs in Brazil: from Qualis to multi-criteria
Pedro Henrique G R P Castro1, Delly Oliveira Filho1
1Universidade Federal de Viçosa, Departamento de Engenharia Agrícola, Av. Peter Henry Rolfs, s/n, 36570-900 Viçosa, MG, Brazil.
Abstract:
Brazilian scientific production has been mostly developed (90%) by Brazilian universities, mainly graduate programs, which must be assessed and ranked by the Brazilian government for their maintenance. The Qualis system is used for this classification by valuing the scientific production of graduate programs, stratifying journals and assigning grades. Several Brazilian researchers affirm that the Qualis system is inaccurate and subjective because it is carried out by a group of researchers. This work aimed to propose methods to evaluate Brazilian scientific production in order to improve the assessment of graduate programs through multi-criteria methods in addition to Qualis. The application of different metrics presented results significantly different from Qualis, including the over valuation of journals with a low international impact factor. The proposed metrics considered: (i) web of science impact factor of the journals; (ii) Citations from articles; (iii) Citations of citations, i.e., a new metric; and (iv) H-Index for researchers. It was proposed the multi-criteria method, composed of the mentioned criteria, in addition to Qualis. For the sample of researchers, it was demonstrated that multi-criteria methods can assess scientific production more accurately. Therefore, they are more adequate to assess the Brazilian graduate programs, considering several internationally accepted criteria.
Related Concept Videos
Qualitative Analysis
There are two main approaches to qualitative analysis:...
Review and Preview
Percentiles are a type of fractile that partition data into...
Quantifying and Rejecting Outliers: The Grubbs Test
Ratio Level of Measurement
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
Quantitative Analysis
In quantitative analysis, two key measurements are made: the sample quantity and a property proportional to the amount of the analyte (the substance being analyzed). This forms the basis of the...
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...

