Related Experiment Video
Updated: Jan 5, 2026

07:35
Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances
Published on: October 11, 2018
7.9K
N-Best Evaluation for Academic Hiring and Promotion
1Department of Psychology, Stanford University, Stanford, CA 94305, USA.
Trends in Cognitive Sciences
|October 24, 2019
Summary
Current scientist evaluations create perverse incentives. An N-best policy, focusing on a few key research products, can better align assessments with the goal of selecting high-quality scientific work.
Area of Science:
- Scientific evaluation methodologies
- Research assessment
- Academic career progression
Background:
- Current systems for evaluating scientists often lead to unintended negative consequences.
- These "perverse incentives" can distort research priorities and practices.
Purpose of the Study:
- To propose an alternative evaluation framework for scientists.
- To align performance metrics with the production of high-quality scientific output.
Main Methods:
- Introduction of the "N-best policy" for scientific evaluation.
- Hiring and promotion committees would solicit a limited number of research products for review.
Main Results:
- This policy shifts the focus from quantity or citation counts to the intrinsic quality of research.
- It encourages a more accurate assessment of a scientist's contributions.
Conclusions:
- The N-best policy offers a more effective method for evaluating scientific merit.
- Implementing this approach can foster a research environment that prioritizes genuine scientific achievement.
Related Concept Videos
Friedman Two-way Analysis of Variance by Ranks
464
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
464
Bonferroni Test
3.3K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
3.3K
Halo Effect
348
The halo effect is a cognitive bias in which an individual's overall impression influences judgments about their specific traits. This psychological phenomenon leads people to associate positive characteristics with those they perceive as generally good and negative characteristics with those they view as bad. This effect is particularly influential in social perception, professional evaluations, and decision-making processes.The Psychological Basis of the Halo EffectThe halo effect is rooted...
348
Quantifying and Rejecting Outliers: The Grubbs Test
3.4K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.4K
Confirmation Biases
7.6K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
7.6K
Ranks
432
Unlike parametric methods, nonparametric statistics are ideal for nominal and ordinal data, requiring fewer assumptions about the population's nature or distribution. This makes nonparametric methods easier to apply and interpret, as they do not depend on parameters like mean or standard deviation. One common approach in nonparametric analysis is to sort data according to a specific criterion. For instance, we might arrange weather data from hottest to coldest days in a month or rank cities...
432

