检查期刊同行评审人建议中的不确定性:一个横截面研究
Adrian Barnett1, Liz Allen2,3, Adrian Aldcroft4
1School of Public Health & Social Work, Queensland University of Technology, Brisbane, Australia.
Royal Society open science
|September 12, 2024
概括
科学的同行评审是不一致的. 一项研究发现,23%的评论员经历了不确定性,影响了期刊文章的推. 这种变化在科学出版中很常见.
科学领域:
- 科学出版业的科学出版.
- 学术传播学术交流
背景情况:
- 同行评审过程对于科学出版至关重要,但因不一致而面临批评.
- 同行评审的不一致性源于评审者的专业知识,培训和经验的差异.
- 审查员的不确定性,即审查员在多个建议之间摇摆不定,有助于决策的变化.
研究的目的:
- 在同行评审过程中量化审稿人内部不确定性的程度.
- 调查与审稿人不确定性相关的因素,如审稿人人口统计和手稿类型.
主要方法:
- 在三个期刊中利用了后审查调查来评估审查员的不确定性.
- 要求审稿人将信任百分比分配给所有可能的建议,超出他们声明的决定.
- 分析调查数据以确定不确定性和相关因素的普遍性.
主要成果:
- 23%的同行评审者报告说,他们的建议存在不确定性 (95% CI 19-27%).
- 评论员不确定性与一个期刊的女性评论员有关.
- 协议论文与一个期刊的审查员不确定性增加有关.
结论:
- 评论员的不确定性是期刊文章的同行评审的一个常见现象.
- 审稿人内部的这种变化是同行评审建议中观察到的整体不一致性的重要组成部分.
- 了解评审者不确定性可以为提高科学同行评审可靠性和一致性的策略提供信息.
相关概念视频
Propagation of Uncertainty from Random Error
656
An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
656
Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K
Proofreading
53.9K
Overview
53.9K
Uncertainty: Overview
529
In analytical chemistry, we often perform repetitive measurements to detect and minimize inaccuracies caused by both determinate and indeterminate errors. Despite the cares we take, the presence of random errors means that repeated measurements almost never have exactly the same magnitude. The collective difference between these measurements - observed values - and the estimated or expected value is called uncertainty. Uncertainty is conventionally written after the estimated or expected value.
529
Cross-reactivity
31.0K
Overview
31.0K
The Scientific Method
225.2K
The scientific method is a detailed, empirical problem-solving process used by biologists and other scientists. This iterative approach involves formulating a question based on observation, developing a testable potential explanation for the observation (called a hypothesis), making and testing predictions based on the hypothesis, and using the findings to create new hypotheses and predictions.
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
225.2K


