测试审查员在同行评审中的定:一个随机对照试验
Ryan Liu1, Steven Jecmen1, Vincent Conitzer1
1School of Computer Science, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America.
PloS one
|November 18, 2024
概括
这项研究调查了审查员在同行评审中的定. 研究人员没有发现证据表明,审查员在看到纠正的纸质版本后更新评论时会以初始分数为.
科学领域:
- 科学传播是科学传播.
- 研究完整性研究完整性
背景情况:
- 代的同行评审过程涉及初始评审,作者回复和评审者评分更新.
- 事证据表明,审稿人可能没有足够调整得分,可能是由于定偏见.
研究的目的:
- 通过实验来调查同行评审者是否表现出对初始分数的定偏见.
- 为了确定初始分数是否影响作者处理反后修订的分数.
主要方法:
- 进行了一项随机对照试验,涉及108名研究人员.
- 实验小组审查了有缺陷的纸质版本,然后修正了一个;控制小组只审查了正确的版本.
- 欺骗是用来隐研究的真正目的.
主要成果:
- 干预成功地创造了群体之间的初始纸质感知差异.
- 在将修订后的分数与对照组分数进行比较时,在总体或评估类别中没有发现定偏差的统计学上显著证据.
结论:
- 在这个实验环境中,审稿人没有证明对初始分数的定偏差.
- 这些发现表明,同行评审更新过程可能不会因得分定而受到重大阻碍.
更多相关视频
12:12Irrelevant Stimuli and Action Control: Analyzing the Influence of Ignored Stimuli via the Distractor-Response Binding Paradigm
Published on: May 14, 2014
10.6K
08:40Isokinetic Robotic Device to Improve Test-Retest and Inter-Rater Reliability for Stretch Reflex Measurements in Stroke Patients with Spasticity
Published on: June 12, 2019
7.4K
相关概念视频
Randomized Experiments
6.7K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
6.7K
Blinding
2.4K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
2.4K
Controls in Experiments
6.9K
When conducting an experiment, it is crucial to have control to reduce bias and accurately measure the dependent variables. It also marks the results more reliable. Controls are elements in an experiment that have the same characteristics as the treatment groups but are not affected by the independent variable. By sorting these data into control and experimental conditions, the relationship between the dependent and independent variables can be drawn. A randomized experiment always includes a...
6.9K
Blind Procedures
10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
The Anchoring-and-Adjustment Heuristic
7.2K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.2K
Group Design
8.9K
The most basic experimental design involves two groups: the experimental group and the control group. The two groups are designed to be the same except for one difference— experimental manipulation. The experimental group gets the experimental manipulation—that is, the treatment or variable being tested—and the control group does not. Since experimental manipulation is the only difference between the experimental and control groups, we can be sure that any differences between...
8.9K
