引用查看和审查:关于在同行评审中引用偏差的研究
Ivan Stelmakh1,2, Charvi Rastogi3, Ryan Liu3
1New Economic School, Moscow, Russia.
PloS one
|July 7, 2023
概括
研究人员可以通过引用评论员来获得更高的分数.
科学领域:
- 图书统计学 图书统计学
- 同行评审研究 研究研究
- 学术传播学术交流
背景情况:
- 引用对于评估科学影响和研究人员职业生涯至关重要.
- 事证据表明,作者引用评论员来影响评价.
- 在同行评审中引用偏差的存在和程度在经验上仍未得到充分探索.
研究的目的:
- 调查引用评论员的工作是否会导致他们对提交的评价产生积极的偏见.
- 量化引用偏差对同行评审得分的影响.
主要方法:
- 在两个主要的机器学习和算法经济学会议的审查过程中进行了一项观察性研究.
- 分析了1314篇论文和1717名评论员.
- 统计模型被用来控制混因素,如纸质和审稿人的专业知识.
主要成果:
- 在研究的两个会议中都检测到引用偏差.
- 引用评论员的作品与在5分利克尔特等级上预期增加约0.23点有关.
- 增加一分的分数可以提高一个提交的立场11%.
结论:
- 同行评审中的引用偏差得到了实证的支持.
- 这种偏见可能会对科学提交的评估产生非微不足道的影响.
- 调查结果对理解学术评估中的公平性和客观性有影响.
相关概念视频
Bias
4.3K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.3K
Systematic Error: Methodological and Sampling Errors
1.5K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.5K
Study Design in Statistics
8.3K
A study design is a set of techniques that allow a researcher to collect and analyze data from different variables defined for a specific research problem. Statistics is commonly for effective study design and more robust experiments,
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
Does aspirin reduce the risk of heart attacks? Is one brand of fertilizer more effective at growing roses than another? Is fatigue as dangerous to a driver as the influence of alcohol? Questions like these are answered using randomized experiments with proper...
8.3K
Accuracy and Errors in Hypothesis Testing
224
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
224
Random and Systematic Errors
11.1K
Scientists always try their best to record measurements with the utmost accuracy and precision. However, sometimes errors do occur. These errors can be random or systematic. Random errors are observed due to the inconsistency or fluctuation in the measurement process, or variations in the quantity itself that is being measured. Such errors fluctuate from being greater than or less than the true value in repeated measurements. Consider a scientist measuring the length of an earthworm using a...
11.1K
Empirical Method to Interpret Standard Deviation
5.3K
The empirical rule, also known as the three-sigma rule, allows a statistician to interpret the standard deviation in a normally distributed dataset. The rule states that 68% of the data lies within one standard deviation from the mean, 95% lies within two standard deviations from the mean, and 99.7% lies within three standard deviations from the mean. Additionally, this rule is also called the 68-95-99.7 rule.
This rule is used widely in statistics to calculate the proportion of data values...
This rule is used widely in statistics to calculate the proportion of data values...
5.3K


