数字分数是否对资助评估具有重要意义? 一个横截面研究
Ivan Buljan1, David G Pina2, Antonija Mijatović3
1Department of Psychology, Faculty of Humanities and Social Sciences in Split, University of Split, Split, Croatia.
F1000Research
|September 2, 2024
概括
从研究建议中删除数字分数并没有改变评论员评论语言. 语言分析显示,在两年中,优势和弱点的写作风格一致,这表明对评论员反特征没有重大影响.
科学领域:
- 研究评估研究评价
- 科学资金政策科学资金政策
- 评价赠款提案 评价赠款提案
背景情况:
- 审稿人使用定量和定性标准进行研究建议.
- 欧盟委员会在2020年取消了玛丽·斯克洛多夫斯卡-库里行动 (MSCA) 创新培训网络 (ITN) 的数字分数.
- 这项研究调查了评分删除后的评审者评论中的语言变化.
研究的目的:
- 在删除数值评分之前和之后评估评论员评论中的语言差异.
- 为了比较2019年 (有分数) 和2020年 (没有分数) 的评审者评论特征.
主要方法:
- 使用2019年和2020年的MSCA ITN评估报告进行的观察性研究.
- 对卓越,影响和实施标准的个人和共识意见的分析.
- 用于评论分析的语言调查和词汇计数 (LIWC) 程序.
主要成果:
- 评论员对提案优点的评论显示出客观性,影响力和积极影响力.
- 关于弱点的评论始终冷酷客观.
- 语言变量只解释了2019年和2020年之间的差异的一小部分 (麦克法登R2=0.03).
结论:
- 删除数字分数并没有改变评论员评论的语言特征.
- 未来的研究应该探索定性方法来评估评论员反中的内容变化.
相关概念视频
Review and Preview
6.9K
In statistics, several tools are used to interpret the data. Measures of central tendency represent the characteristics of the data, such as mean, median, and mode. Additionally, measures of variance like standard deviation and range are used to find the spread of data from the mean. Relative standing measures the distance between data locations. Commonly used measures of relative standings are percentile, z score, and quartiles.
Percentiles are a type of fractile that partition data into...
Percentiles are a type of fractile that partition data into...
6.9K
Weighted Mean
5.0K
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
5.0K
Reliability and Validity
12.7K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
12.7K
Introduction to z Scores
360
A z score (or standardized value) is measured in units of the standard deviation. It indicates how many standard deviations the value x is above (to the right of) or below (to the left of) the mean, μ. Values of x that are larger than the mean have positive z scores, and values of x that are smaller than the mean have negative z scores. If x equals the mean, then x has a zero z score. It is important to note that the mean of the z scores is zero, and the standard deviation is one.
z scores...
z scores...
360
Measures of Central Tendency
16.0K
The "center" of a data set is also a way of describing location. The two most widely used measures of the "center" of the data are the mean (average) and the median. The words "mean" and "average" are often used interchangeably. The substitution of one word for the other is common practice. The technical term is "arithmetic mean" and "average" is technically a center location. However, in practice among non-statisticians,...
16.0K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
124
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
124


