Related Experiment Video

Updated: Sep 20, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Adding an Attention Layer Improves the Performance of a Neural Network Architecture for Synonymy Prediction in the

Vinh Nguyen¹, Olivier Bodenreider¹

¹National Library of Medicine, National Institutes of Health, USA.

Studies in Health Technology and Informatics

|June 8, 2022

Abstract

Background:

Terminology integration at the scale of the UMLS Metathesaurus (i.e., over 200 source vocabularies) remains challenging despite recent advances in ontology alignment techniques based on neural networks.

Objectives:

To improve the performance of the neural network architecture we developed for predicting synonymy between terms in the UMLS Metathesaurus, specifically through the addition of an attention layer.

Methods:

We modify our original Siamese neural network architecture with Long-Short Term Memory (LSTM) and create two variants by (1) adding an attention layer on top of the existing LSTM, and (2) replacing the existing LSTM layer by an attention layer.

Results:

Adding an attention layer to the LSTM layer resulted in increasing precision to 92.38% (+3.63%) and F1 score to 91,74% (+1.13%), with limited impact on recall at 91.12% (-1.42%).

Conclusions:

Although limited, this increase in precision substantially reduces the false positive rate and minimizes the need for manual curation.

Keywords:

Computer Neural Networks Unified Medical Language System

More Related Videos

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Related Concept Videos

Conjugate Addition (1,4-Addition) vs Direct Addition (1,2-Addition)

Conjugate Addition (1,4-Addition) vs Direct Addition (1,2-Addition)

α,β-Unsaturated carbonyl compounds with two electrophilic sites, the carbonyl carbon, and the β carbon, are susceptible to nucleophilic attack via two modes: conjugate or 1,4-addition and direct or 1,2-addition.
Conjugate addition results in a thermodynamically stable product. The reaction retains the stronger C=O bond at the expense of the weaker C=C π bond. The process is slow as the β carbon is less electrophilic than the carbonyl carbon.
Direct addition products are...

Improving Translational Accuracy

Improving Translational Accuracy

Elaborative Rehearsals

Elaborative Rehearsals

Elaborative rehearsal is a crucial cognitive strategy that strengthens information encoding in long-term memory by making meaningful connections between new data and pre-existing knowledge. This approach contrasts with maintenance rehearsal, which involves simple repetition without delving into the significance of the information. While maintenance rehearsal might temporarily keep information active in short-term memory, it is less effective for long-term retention.
The effectiveness of...

Associative Learning

Associative Learning

Associative learning is a fundamental concept in behavioral psychology, wherein a connection is established between two stimuli or events, leading to a learned response. This process is critical in understanding how behaviors are acquired and modified. Conditioning, the mechanism through which associations are formed, can be divided into two main types: classical conditioning and operant conditioning, each elucidating different aspects of associative learning.
Classical conditioning, also known...

Association Areas of the Cortex

Association Areas of the Cortex

Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...

Conjugate Addition to α,β-Unsaturated Carbonyl Compounds

Conjugate Addition to α,β-Unsaturated Carbonyl Compounds

α,β-Unsaturated carbonyl compounds are molecules bearing a carbonyl and alkene functionality in conjugation with each other. The conjugation in the molecule leads to three resonance structures. The hybrid form exhibits two probable electrophilic sites: the carbonyl carbon and the β carbon.

Articles linked to this work by shared authors, journal, and citation graph.

Living donor liver transplantation versus donation after circulatory death in the era of normothermic machine perfusion: Insights from a national cohort.

Surgery·2026

[Psychiatric emergencies in the prehospital setting : interprofessional models].

Revue medicale suisse·2026

Teachers' ADHD Endorsement and Symptom Severity Ratings: The Role of Culture, Knowledge, and Attitudes.

Journal of attention disorders·2026

Disability identity, ADA knowledge, and self-advocacy among cancer survivors.

Journal of cancer survivorship : research and practice·2026

Label quality as a bottleneck for YOLO detection in all-weather autonomous driving using the MUSES dataset.

Discover electronics·2026

Multimodal ultra-high-field MRI, clinical, cognitive, and genetic profiles across the ALS-FTD spectrum.

Scientific data·2026

See all related articles