为了捍卫研究人员评估中的定量指标
John P A Ioannidis1, Zacharias Maniadis2,3
1Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, and Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, California, United States of America.
PLoS biology
|December 4, 2023
概括
研究人员的定性评估是昂贵和有缺陷的. 严格的,现场调整的定量指标,尽管受到批评,但如果集中实施,可以提高研究实践.
科学领域:
- 研究评估方法研究评估方法.
- 科学生产力指标科学生产力指标
背景情况:
- 研究人员的定性评估是资源密集型的,容易出现错误.
- 当前的评估方法在非功利主义的研究环境中往往是不可持续的.
研究的目的:
- 探索定量指标在改善研究实践方面的潜力.
- 解决传统的定性研究人员评估的局限性.
主要方法:
- 分析定性评估方法的缺点.
- 在研究评估中应用定量指标的概念框架.
主要成果:
- 定性评估带来了重要的资源和准确性挑战.
- 定量指标为评估研究绩效提供了一个可行的替代方案.
- 经过现场调整和集中化的定量指标显示出对严格评估的前景.
结论:
- 量化指标,当严格设计和应用时,可以克服定性评估的局限性.
- 集中化,现场调整的定量指标可以促进更公平,更有效的研究评估系统.
相关概念视频
Statistical Analysis: Overview
6.6K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.6K
Detection of Gross Error: The Q Test
6.1K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.1K
Ratio Level of Measurement
18.1K
The way a set of data is measured is called its level of measurement. Correct statistical procedures depend on a researcher being familiar with levels of measurement. For analysis, data are classified into four levels of measurement—nominal, ordinal, interval, and ratio.
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
A set of data measured using the ratio scale takes care of the ratio problem and provides complete information. Ratio scale data are like interval scale data, except they have a zero point and ratios can be calculated....
18.1K
Regression Toward the Mean
6.3K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.3K
Measures of Intelligence
7.3K
Psychologists measure intelligence by using standardized tests that produce a score known as the intelligence quotient or IQ. To understand IQ tests, it's important to recognize the key principles behind their construction: validity, reliability, and standardization.
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
7.3K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
130
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
130


