在科学论文中量化大型语言模型的使用情况
Weixin Liang1, Yaohui Zhang2, Zhengxuan Wu3
1Department of Computer Science, Stanford University, Stanford, CA, USA. wxliang@stanford.edu.
Nature human behaviour
|August 4, 2025
概括
大型语言模型 (LLM) 越来越多地用于科学写作. 对100多万篇论文的分析显示,LLM修改的数量稳步增加,特别是在计算机科学领域.
科学领域:
- 科学出版业的科学出版.
- 学术写作学术写作
- 研究传播研究传播.
背景情况:
- 关于在学术写作中采用大型语言模型 (LLM) 的程度存在猜测.
- 科学出版对于分享研究成果至关重要.
研究的目的:
- 系统地分析科学论文中LLM修改内容的流行程度.
- 随着时间的推移,跟踪学术写作中LLM使用的趋势和增长.
主要方法:
- 分析了从2020年1月到2024年9月的1,121,912份预印稿和发表论文.
- 利用基于单词频率转移的人口级框架来估计LLM修改.
- 数据来源包括arXiv,bioRxiv和Nature投资组合期刊.
主要成果:
- 在科学学科中观察到LLM使用量的稳步增加.
- 计算机科学论文显示LLM修改的最大和最快的增长,高达22%.
- 数学论文和"自然"杂志的投资组合显示了较低的LLM修改率 (高达9%).
- 较高的LLM修改估计与第一作者频繁发布预印稿,拥挤的研究领域和较短的论文长度相关.
结论:
- 在科学写作中,LLM正在被广泛采用和使用.
- 这些发现突出了LLM在研究传播中整合的显著和不断增长的趋势.
- 学科和作者特定因素影响科学出版物中LLM修改率.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
579
06:48Lexical Decision Task for Studying Written Word Recognition in Adults with and without Dementia or Mild Cognitive Impairment
Published on: June 25, 2019
9.3K
相关概念视频
Quantifying Work
21.1K
As a system undergoes a change, its internal energy can change, and energy can be transferred from the system to the surroundings, or from the surroundings to the system.
21.1K
Language and Cognition
442
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
442
Sample Size Calculation
3.8K
Knowledge of the sample size is the first requirement to conduct random sampling or an experiment. The sample size is the total number of units, observations, or groups (in some cases) used to get the data to estimate a population parameter. As the name suggests, the sample size is that of the sample drawn from the population and differs from the population size.
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
The sample size for the given experiment or sampling effort is fundamental to any study design. Sample size decides the number of...
3.8K
Improving Translational Accuracy
2.7K
2.7K
Estimation of the Physical Quantities
6.0K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
6.0K
Language Development
450
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
450
