结构化的同行评审:来自23个爱思唯尔期刊的试点结果
Mario Malički1,2,3, Bahar Mehmani4
1Stanford Program on Research Rigor and Reproducibility (SPORR), Stanford University, Stanford, CA, United States.
PeerJ
|July 1, 2024
概括
结构化的同行评审看起来很有前途,评审者适应得很好,对手稿建议的同意越来越多. 然而,在评估数据解释和统计分析质量方面,仍然存在挑战.
科学领域:
- 科学出版业的科学出版.
- 学术传播学术交流
- 同行评审过程是同行评审的过程.
背景情况:
- 传统的同行评审缺乏一致性,阻碍了手稿和评审质量的评估.
- 为了评估结构化同行评审的实施,进行了一项试点研究.
- 这项研究旨在探索审查员的参与,同意水平,并完善结构化问题.
研究的目的:
- 评估审查员适应结构化同行评审格式的情况.
- 分析审稿人对特定手稿方面的同意.
- 为了比较结构化同行评审实施前后的协议率.
主要方法:
- 一个结构化的同行评审格式,包括9个问题,在220个期刊中进行了试点.
- 分析了来自23个期刊的107份手稿,每份有两份审查报告.
- 用定性方法独立分析了两个评级员的评审者答案.
主要成果:
- 评审者 (92%) 回答了结构化问题,最详细的答案是关于可重复性的方法.
- 对于手稿流量 (72%) 的同意是最高的,对数据解释 (53%) 和统计分析 (52%) 的同意是最低的.
- 与实施前相比,对最终建议的绝对同意率从31% (p=0.0275) 增加到41%,从31% (p=0.0275).
结论:
- 审稿人适应了结构化的同行评审,涵盖了比传统报告更多的主题.
- 在解释结果和统计分析质量方面仍然存在分歧.
- 结构化的同行评审可能会改善建议协议,但需要进一步的研究来确认好处.
相关概念视频
The Scientific Method
220.3K
The scientific method is a detailed, empirical problem-solving process used by biologists and other scientists. This iterative approach involves formulating a question based on observation, developing a testable potential explanation for the observation (called a hypothesis), making and testing predictions based on the hypothesis, and using the findings to create new hypotheses and predictions.
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
Generally, predictions are tested using carefully-designed experiments. Based on the outcome of these...
220.3K
Feedback Inhibition
44.1K
Biochemical reactions are occurring constantly in cells, converting starting substances to different products, usually with the help of enzymes that speed the reactions. Without enzymes, it would take far too long for most reactions to occur to be useful to the cell!
44.1K
Proofreading
52.1K
Overview
52.1K
Feedback Loops
43.9K
In most cases, excessive hormone production is prevented by negative feedback—a loop that starts with a stimulus inducing the release of a particular substance, like a hormone, to maintain a certain level before triggering a signal that results in a decrease in further release of the hormone.
43.9K
Types of Selection
37.5K
Natural selection influences the frequencies of particular alleles and phenotypes within populations in several different ways. Primarily, natural selection can be directional, stabilizing, or disruptive. Directional selection favors one extreme trait and shifts the population towards that phenotype while selecting against individuals displaying alternate traits. Stabilizing selection favors an intermediate trait with a narrow range of variation. Deviation from the optimal phenotype towards an...
37.5K
Test Cross
32.8K
Alleles are different forms of the same gene. Humans and other diploid organisms inherit two alleles of every gene, one from each parent.
32.8K


