Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A Gated Dilated Convolution with Attention Model for Clinical Cloze-Style Reading Comprehension.

International journal of environmental research and public health·2020

Same author

Parallel Structure Deep Neural Network Using CNN and RNN with an Attention Mechanism for Breast Cancer Histology Image Classification.

Cancers·2019

Same journal

Selecting, Scaling, and Measuring the Value of Ambient AI in a Nonacademic Health System: Multiphase Pilot Study.

JMIR medical informatics·2026

Same journal

Prediction of Early Hospital Admission (≤24 Hours) After Stroke Using Machine Learning and Deep Learning: Multicenter Study From China.

JMIR medical informatics·2026

Same journal

Assessing the Feasibility and Acceptability of Implementing a Preclinic Vital Signs Assessment in Primary Care: Cross-Sectional Pilot Study.

JMIR medical informatics·2026

Same journal

Candidate Passive Sensor Suite Technologies for Tactical Combat Casualty Care Environments: Comparative Assessment Study.

JMIR medical informatics·2026

Same journal

Relevance of the uMap Collaborative Platform as Support for Choropleth Mapping: A Traffic‒Light Statistical Signal Atlas of All-Cause Mortality-First French Lockdown.

JMIR medical informatics·2026

Same journal

Ambient AI Scribe Implementation in an Ambulatory Setting in a Single Medical Group: Prospective Study.

JMIR medical informatics·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Nov 20, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

ALBERT-Based Self-Ensemble Model With Semisupervised Learning and Data Augmentation for Clinical Semantic Textual

Junyi Li¹, Xuejie Zhang¹, Xiaobing Zhou¹

¹School of Information Science and Engineering, Yunnan University, Kunming, China.

JMIR Medical Informatics

|January 22, 2021

Summary

This summary is machine-generated.

This study enhances clinical textual semantic similarity calculations using data augmentation and a self-ensemble ALBERT model. The approach improves model learning efficiency and performance, especially with small medical datasets.

Keywords:

ALBERT algorithm clinical semantic textual similarity data augmentation data sets model self-ensemble semantic semisupervised

More Related Videos

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

Related Experiment Videos

Last Updated: Nov 20, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Author Spotlight: Advancing Alzheimer's Research – Exploring Early Detection and Multi-Omics Approaches

Published on: December 15, 2023

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Objectification of Tongue Diagnosis in Traditional Medicine, Data Analysis, and Study Application

Published on: April 14, 2023

Area of Science:

Natural Language Processing
Medical Informatics
Machine Learning

Background:

Calculating textual semantic similarity is crucial for screening medical information.
Electronic medical records and research documents are vital data resources.
Effective medical textual semantic similarity calculation is an urgent challenge.

Purpose of the Study:

To address insufficient model learning with small medical datasets.
To overcome information loss during long-distance propagation in models.
To improve the accuracy of clinical textual semantic similarity calculations.

Main Methods:

Utilized a text data augmentation technique.
Employed a self-ensemble ALBERT model.
Applied semisupervised learning for clinical textual semantic similarity.

Main Results:

Achieved a Pearson correlation coefficient of 0.92.
Surpassed the best previous method by 2 percentage points in clinical semantic textual similarity.
Demonstrated superior performance compared to methods in the 2019 NLP Clinical Challenges.

Conclusions:

Data augmentation effectively increases dataset size for small medical datasets.
Semisupervised learning boosts model efficiency.
Self-ensemble methods enhance model performance, showing great potential for medical applications.