评价同行评价. 评价同行评价. 一个分级仪器的试点测试
I D Feurer1, G J Becker, D Picus
1Journal of Vascular and Interventional Radiology, Nashville, TN.
JAMA
|July 13, 1994
概括
这项研究开发了一种可靠的评分工具,用于评估同行评审质量. 该工具表现出强大的互评级可靠性和初步有效性,支持编辑使用它.
科学领域:
- 医学写作和科学传播.
- 研究完整性和质量评估.
背景情况:
- 评估同行评审的质量对于保持科学严谨性至关重要.
- 需要标准化工具来确保对同行评审的一致和客观评估.
研究的目的:
- 为编辑设计的新型评分工具的可靠性和初步有效性进行评估.
- 为编辑提供一个结构化的方法来评估同行评审质量.
主要方法:
- 使用了23份手稿中的53份同行评审的连续样本.
- 使用类内相关系数和ANOVA (n=41) 测试了interrater可靠性.
- 使用肯德尔一致系数 (n=12) 评估了与初步标准相关的有效性.
主要成果:
- 评级仪表表现出高级别之间的可靠性 (类内相关系数=0.84,P<.001).
- 对差异的分析显示,平均得分没有显著差异 (P = .46).
- 表明了与初步标准相关的有效性 (肯达尔一致系数 = 0.94,P = 0.038).
结论:
- 开发的评分工具可靠地评估同行评审的质量.
- 内容验证已经完成,建议进一步进行与标准相关的验证.
- 该工具为编辑提供了一个有前途的工具,以加强同行评审评估.
相关概念视频
01:29Self-Evaluation Maintenance Model
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
01:24Sources of Self-Esteem II: Performance Feedback
Self-esteem is intricately tied to our perception of competence and our ability to exert control over our lives. One of the primary sources of this perception is performance feedback — the ongoing evaluation of our actions in terms of success and failure. According to Franks and Marolla (1976), people derive self-worth from experiencing themselves as causal agents, capable of achieving goals and overcoming obstacles. This process nurtures a critical component of self-esteem: self-efficacy,...