作者对论文的看法如何与共同作者的看法和同行评审决定相比较?
Charvi Rastogi1, Ivan Stelmakh2, Alina Beygelzimer3
1Machine Learning Department, Carnegie Mellon University, Pittsburgh, Pennsylvania, United States of America.
PloS one
|April 10, 2024
概括
作者经常高估他们的论文接受率,在性别和评论员经验之间观察到显著差异. 同行评审决策和作者排名经常有所不同,但评审过程往往会提高作者对其作品的看法.
科学领域:
- 计算机科学 计算机科学
- 学术出版学术出版
- 同行评审是一项同行评审.
背景情况:
- 了解作者对同行评审的看法与实际结果对改善学术出版过程至关重要.
- 之前的研究没有广泛探讨作者自我评估的准确性及其与大规模计算机科学会议上的同行评审结果的相关性.
研究的目的:
- 在一个主要的计算机科学会议上,调查作者预测与实际接受率之间的对齐.
- 分析作者对科学贡献的自我排名及其与预测接受和同行评审决定的关系.
- 评估同行评审过程对作者对自己作品的看法的影响.
主要方法:
- 对超过23000名提交到NeurIPS 2021的作者进行了调查,涵盖预测的接受概率,自我感知的科学贡献排名和审查后的感知变化.
- 对调查数据的分析与实际纸张接受率和同行评审决策的分析.
- 基于人口统计 (性别) 和评论员身份的作者认知的统计比较.
主要成果:
- 作者大大高估了接受概率 (平均70%的预测率与25%的实际率相比).
- 女性作者比男性作者有略高的校准错误;受邀评论员比非评论员更好地校准.
- 作者对贡献的排名通常与接受预测 (93%) 相一致,但作者对排名的同行评审协议仅为67%左右.
- 大约30%的作者报告说,无论接受状态如何,他们的作品在审查后的感知有所改善.
结论:
- 在高风险的计算机科学会议上,作者自我评估容易被高估,突出了作者期望与现实之间的差距.
- 同行评审决策和作者自我排名显示出相当大的分歧,表明潜在的偏见或不同的评估标准.
- 同行评审过程,即使是被拒绝的论文,也可以积极影响作者对他们的研究的看法,强调其价值超出了接受决策.
更多相关视频
相关概念视频
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.2K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.2K
02:57The Sense of Self: Reflected Self-Appraisal and Social Comparison
49.9K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
49.9K
00:52Social Proof
27.7K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.7K
02:45Self-Discrepancy Theory
18.3K
One influential perspective on what motivates people's behavior is detailed in Tory Higgin's self-discrepancy theory (Higgins, 1987). He proposed that people hold disagreeing internal representations of themselves that lead to different emotional states.
18.3K
01:25Factors Affecting Perception
1.6K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.6K
00:46Feedback Inhibition
53.9K
Biochemical reactions are occurring constantly in cells, converting starting substances to different products, usually with the help of enzymes that speed the reactions. Without enzymes, it would take far too long for most reactions to occur to be useful to the cell!
53.9K