Related Experiment Video
Updated: Sep 17, 2025
3D Scanning Technology Bridging Microcircuits and Macroscale Brain Images in 3D Novel Embedding Overlapping Protocol
Published on: May 12, 2019
CSpace: a concept embedding space for biomedical applications
Danilo Tomasoni1, Luca Marchetti1,2
1Fondazione The Microsoft Research-University of Trento Centre for Computational and Systems Biology (COSBI), 38068 Rovereto (TN), Italy.
Motivation:
The rise of transformer-based architectures has dramatically improved our ability to analyze natural language. However, the power and flexibility of these general-purpose models come at the cost of highly complex model architectures with billions of parameters that are not always needed.
Results:
In this work, we present CSpace: a concise word embedding of biomedical concepts that outperforms all alternatives in terms of out-of-vocabulary ratio and semantic textual similarity task, and has comparable performance with respect to transformer-based alternatives in the sentence similarity task. This ability can serve as the foundation for semantic search by enabling efficient retrieval of conceptually related terms. Additionally, CSpace incorporates ontological identifiers (MeSH, NCBI gene and taxonomy IDs), enabling computationally efficient disease, gene or condition relatedness measurement, potentially unlocking previously unknown disease-condition associations.
Availability And Implementation:
Full and compressed models are available on Zenodo at https://doi.org/10.5281/zenodo.14781672, while training code, examples, interactive visualizations and experiments are available at https://doi.org/10.5281/zenodo.15125706 and on the GitHub repository.
