Related Experiment Video
Updated: Aug 19, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Natural language processing analysis applied to COVID-19 open-text opinions using a distilBERT model for sentiment
Mario Jojoa1, Parvin Eftekhar2, Behdin Nowrouzi-Kia2
1eVIDA Lab, University of Deusto, Bilbo, Spain.
This study developed a natural language processing model using distilBERT to analyze public sentiment during COVID-19 lockdowns. The model effectively detected positive and negative feelings in survey responses, aiding future pandemic preparedness.
Area of Science:
- Natural Language Processing
- Computational Social Science
- Public Health
Background:
- The COVID-19 pandemic significantly impacted global quality of life and lifestyles.
- Government-imposed lockdowns in 2020 necessitated understanding public sentiment during this unprecedented period.
Purpose of the Study:
- To develop and evaluate a natural language processing model for detecting positive and negative sentiments in open-text survey responses from the pandemic era.
- To contribute to the understanding of public feelings during virus-induced lockdowns for future challenges.
Main Methods:
- A distilBERT transformer model was proposed for sentiment analysis.
- Three distinct approaches were employed for model comparison.
- Sentiment analysis was performed on open-text survey answers collected during the pandemic.
Main Results:
- The best-performing model achieved an average Accuracy of 0.823.
- The model demonstrated strong performance with an average Precision of 0.826.
- Average Recall and F1 Score were reported as 0.793 and 0.803, respectively.
Conclusions:
- The proposed distilBERT model effectively detects public sentiment in pandemic-related survey data.
- The findings highlight the utility of NLP in understanding societal responses to global health crises.
- This research provides a foundation for sentiment analysis in future public health emergencies.
More Related Videos
Related Concept Videos
Stereotype Content Model
Classification of Illness
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
How Data are Classified: Categorical Data
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
Single Nucleotide Polymorphisms-SNPs
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
MALDI-TOF Mass Spectrometry
Matrix-assisted laser desorption ionization (MALDI) is a commonly...

