科学中的质量评估是否受到定效应的影响? 建议进行后续研究
Lutz Bornmann1, Christian Ganser2
1Science Policy and Strategy Department, Administrative Headquarters of the Max Planck Society, Munich, Germany.
PloS one
|November 1, 2023
概括
图书计量可能会创造科学的社会秩序,而不仅仅是反映它. 这项研究测试了引用数或甚至随机数是否影响研究人员的质量评估,这表明研究评估中的认知偏见.
科学领域:
- 研究评估研究评估
- 图书统计学 图书统计学
- 科学心理学科学心理学
背景情况:
- 图书计量是为了测量科学中的社会秩序.
- 之前的一项研究表明,文献计量可能会创造这种顺序,类似于定和调整启发式.
- 这项后续研究解决了关于研究评估中的这种启发式的开放问题.
研究的目的:
- 在科学论文评估中实证地研究定和调整启发式.
- 为了确定引用数量或与质量无关的数字是否影响质量判断.
- 探索文献计量是否创造或仅仅反映了科学中的社会秩序.
主要方法:
- 通过科学网络识别的对应作者的调查.
- 作者在不同的实验条件下 (引用数据,访问代码或控制) 评估引用的论文.
- 统计分析以衡量质量评估对值的调整.
主要成果:
- 分析将量化质量评估被引用数调整的程度 (与质量相关的).
- 分析将评估与质量无关的点 (访问代码) 是否也会影响评估.
- 调查这些调整的强度是否表明文献计量创造了社会秩序.
结论:
- 调查结果将澄清认知启发术在研究评估中的作用.
- 结果将告知文献计量指标是否塑造科学声誉或准确地反映它.
- 这项研究有助于理解科学质量的社会构造.
更多相关视频
10:17Improving Student Outcomes with an Adaptable Molecular Cloning Course-Based Undergraduate Research Experience
Published on: November 15, 2024
1.1K
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
4.0K
相关概念视频
The Anchoring-and-Adjustment Heuristic
7.3K
In order to make good decisions, we use our knowledge and our reasoning. Often, this knowledge and reasoning is sound and solid. However, sometimes, we are swayed by biases or by others manipulating a situation. For example, let’s say you and three friends wanted to rent a house and had a combined target budget of $1,600. The realtor shows you only very run-down houses for $1,600 and then shows you a very nice house for $2,000. Might you ask each person to pay more in rent to get the...
7.3K
Naturalistic Observations
15.5K
If you want to understand how behavior occurs, one of the best ways to gain information is to simply observe the behavior in its natural context. However, people might change their behavior in unexpected ways if they know they are being observed. How do researchers obtain accurate information when people tend to hide their natural behavior? As an example, imagine that your professor asks everyone in your class to raise their hand if they always wash their hands after using the restroom. Chances...
15.5K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
133
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
133
Statistical Significance
20.2K
Once data is collected from both the experimental and the control groups, a statistical analysis is conducted to find out if there are meaningful differences between the two groups. A statistical analysis determines how likely any difference found is due to chance (and thus not meaningful). In psychology, group differences are considered meaningful, or significant, if the odds that these differences occurred by chance alone are 5 percent or less. Stated another way, if we repeated this...
20.2K
Bias
4.3K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.3K
Longitudinal Research
12.0K
Sometimes we want to see how people change over time, as in studies of human development and lifespan. When we test the same group of individuals repeatedly over an extended period of time, we are conducting longitudinal research. Longitudinal research is a research design in which data-gathering is administered repeatedly over an extended period of time. For example, we may survey a group of individuals about their dietary habits at age 20, retest them a decade later at age 30, and then again...
12.0K
