Related Experiment Video
Updated: Sep 9, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Scalable Scientific Interest Profiling Using Large Language Models
Yilun Liang1,2, Gongbo Zhang1, Edward Sun3
1Department of Biomedical Informatics, Columbia University, New York, NY, USA.
Large Language Models (LLMs) can automate scientific interest profiling. Profiles generated using Medical Subject Headings (MeSH) terms showed better readability and were preferred over abstract-based profiles, despite differences from human-written summaries.
Area of Science:
- Biomedical Informatics
- Artificial Intelligence in Research
- Scientific Communication
Background:
- Scientist research profiles are crucial for talent discovery and collaboration but are often outdated.
- Automated and scalable methods are needed to maintain current research profiles.
Purpose of the Study:
- To design and evaluate Large Language Models (LLMs)-based methods for generating scientific interest profiles.
- To compare machine-generated profiles (from PubMed abstracts and MeSH terms) with researchers' self-summarized interests.
Main Methods:
- Utilized GPT-4o-mini to summarize research interests for 595 faculty members based on their PubMed abstracts and MeSH terms.
- Collected publication data (titles, MeSH terms, abstracts) from CUIMC faculty.
- Conducted manual and automated evaluations to compare machine-generated and self-written profiles.
Main Results:
- Lexical overlap was low between machine-generated and self-written profiles (low ROUGE-L, BLEU, METEOR scores).
- Moderate semantic similarity was found using BERTScore (F1: 0.542 MeSH-based, 0.555 abstract-based).
- Manual reviews favored MeSH-based profiles (67.86%) for readability (93.44%) and overall impression (77.78% good/excellent).
Conclusions:
- LLMs offer a scalable solution for automating scientific interest profiling.
- MeSH-term-derived profiles demonstrate superior readability and user preference compared to abstract-derived profiles.
- Machine-generated profiles differ in concept choice from human-written ones, highlighting potential for novel idea generation in manual profiles.
More Related Videos
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
Related Concept Videos
Improving Translational Accuracy
Ribosome Profiling
Applications of ribosome profiling
Ribosome profiling has many applications, including in vivo monitoring of translation inside a particular organ or tissue type and quantifying new protein synthesis levels.
The technique...
Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
Scaling
Language and Cognition
Aggregates Classification
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...