编辑的书面反对评论质量的影响:两个随机试验
Michael L Callaham1, Robert K Knopp, E John Gallagher
1Department of Emergency Medicine, University of California, San Francisco, CA 94143-0208. mlc@medicine.ucsf.edu
JAMA
|June 1, 2002
概括
在两项研究中,对同行评审者的书面反并没有改善其随后的评审质量. 这种简单的教育工具似乎对加强同行评审过程无效.
科学领域:
- 医学教育 医学教育
- 学术出版学术出版
- 同行评审是一项同行评审.
背景情况:
- 提高同行评审的质量是学术出版的公认需求.
- 然而,提高评审员绩效的有效方法在很大程度上是未知的.
- 这项研究调查了书面反对后续评审员表现的影响.
研究的目的:
- 为了确定向同行评审者提供书面反是否会影响他们未来的评审质量.
- 评估编辑反作为同行评审者教育工具的有效性.
主要方法:
- 在"紧急医疗年鉴" (Annals of Emergency Medicine) 上进行了两项与同行评审的研究.
- 审查者被随机分配,接受标准审查条件 (控制) 或额外的书面反 (干预).
- 反包括其他评论员的未评分的评论和编辑的决定信,细节和支持程度各不相同.
主要成果:
- 在研究1 (评分低的评论员) 中,反显示没有改善,并且对评论质量产生负面影响的趋势.
- 在研究2 (平均评审员) 中,更广泛和支持性的反也未能在评审员表现上取得任何改善.
- 对182 (研究1) 和324 (研究2) 评论的编辑质量评级 (1-5) 的分析发现干预组没有显著的积极变化.
结论:
- 来自编辑的简单的书面反似乎不是提高同行评审员表现的有效方法.
- 在这两项研究中,无论是最小的反还是广泛的反都没有显著提高后续审查的质量.
- 替代策略可能是必要的,以提高同行评审过程的质量.
相关概念视频
00:46Feedback Inhibition
Biochemical reactions are occurring constantly in cells, converting starting substances to different products, usually with the help of enzymes that speed the reactions. Without enzymes, it would take far too long for most reactions to occur to be useful to the cell!
01:01Feedback Loops
In most cases, excessive hormone production is prevented by negative feedback—a loop that starts with a stimulus inducing the release of a particular substance, like a hormone, to maintain a certain level before triggering a signal that results in a decrease in further release of the hormone.
02:01Group Design
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between the two are due to...
02:07Blind Procedures
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which child was...
01:13Randomized Experiments
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
01:24Effects of feedback
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...