使用大型语言模型进行可扩展的科学兴趣分析
Yilun Liang1,2, Gongbo Zhang1, Edward Sun3
1Department of Biomedical Informatics, Columbia University, New York, NY, USA.
ArXiv
|September 2, 2025
概括
大型语言模型 (LLM) 可以自动化科学兴趣分析. 使用医学主题标题 (MeSH) 术语生成的个人资料显示出更好的可读性,并且优于基于抽象的个人资料,尽管与人写的摘要有所不同.
科学领域:
- 生物医学信息学
- 研究中的人工智能
- 科学交流
背景情况:
- 科学家的研究资料对于人才发现和合作至关重要, 但往往已经过时了.
- 需要自动化和可扩展的方法来保持当前的研究概况.
研究的目的:
- 设计和评估基于大型语言模型 (LLM) 的方法来生成科学兴趣.
- 将机器生成的个人资料 (来自PubMed摘要和MeSH术语) 与研究人员自我总结的兴趣进行比较.
主要方法:
- 利用GPT-4o-mini根据他们的PubMed摘要和MeSH术语总结了595名教师的研究兴趣.
- 收集了CUIMC教师的出版物数据 (标题,MeSH术语,摘要).
- 进行手动和自动评估以比较机器生成和自写的配置文件.
主要成果:
- 机器生成和自写的个人资料之间的词汇重叠很低 (低的ROUGE-L,BLEU,METEOR得分).
- 使用BERTScore发现了中等的语义相似性 (F1:基于MeSH的0. 542,基于抽象的0. 555).
- 手动评价偏好基于MeSH的配置文件 (67.86%) 的可读性 (93.44%) 和整体印象 (77.78% 好/优秀).
结论:
- 提供可扩展的解决方案来自动化科学兴趣分析.
- 与抽象衍生的配置文件相比,MeSH术语衍生的配置文件显示出更高的可读性和用户偏好.
- 机器生成的个人资料在概念选择上与人写的个人资料有所不同,这凸显了手工个人资料中产生新想法的潜力.
更多相关视频
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
570
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.7K
相关概念视频
Improving Translational Accuracy
11.8K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.8K
Ribosome Profiling
3.6K
Ribosome profiling or ribo-sequencing is a deep sequencing technique that produces a snapshot of active translation in a cell. It selectively sequences the mRNAs protected by ribosomes to get an insight into a cell’s translation landscape at any given point in time.
Applications of ribosome profiling
Ribosome profiling has many applications, including in vivo monitoring of translation inside a particular organ or tissue type and quantifying new protein synthesis levels.
The technique...
Applications of ribosome profiling
Ribosome profiling has many applications, including in vivo monitoring of translation inside a particular organ or tissue type and quantifying new protein synthesis levels.
The technique...
3.6K
Language Development
444
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
444
Scaling
314
In designing and analyzing filters, resonant circuits, or circuit analysis at large, working with standard element values like 1 ohm, 1 henry, or 1 farad can be convenient before scaling these values to more realistic figures. This approach is widely utilized by not employing realistic element values in numerous examples and problems; it simplifies mastering circuit analysis through convenient component values. The complexity of calculations is thereby reduced, with the understanding that...
314
Language and Cognition
438
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
438
Aggregates Classification
380
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
380
