Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Blinding01:11

Blinding

2.4K
Blinding is a commonly used method of not telling participants which treatment a subject is receiving. Blinding is a critical part of a randomized control trial or RCT. It reduces the bias that affects the results. In an RCT, blinding is used in the form of a placebo. A placebo effect occurs when untreated subjects falsely believe they have received the treatment and report improved symptoms. A placebo or a dummy treatment is administered to subjects to negate the bias caused by such an effect.
2.4K
Self-Presentation: Self-Monitoring and Self-Handicapping02:05

Self-Presentation: Self-Monitoring and Self-Handicapping

39.0K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
39.0K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

126
Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
126
Randomized Experiments01:13

Randomized Experiments

6.9K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
6.9K
Blind Procedures02:07

Blind Procedures

10.6K
Ideally, the people who observe and record the children’s behavior are unaware of who was assigned to the experimental or control group, in order to control for experimenter bias. Experimenter bias refers to the possibility that a researcher’s expectations might skew the results of the study. Remember, conducting an experiment requires a lot of planning, and the people involved in the research project have a vested interest in supporting their hypotheses. If the observers knew which...
10.6K
Bias01:22

Bias

4.2K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.2K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Goals and strategies for the indexing of publication types and study designs.

Database : the journal of biological databases and curation·2026
Same author

SPIRIT-CONSORT-ELM: Element-Level Assessment of Randomized Controlled Trial Reporting Using Large Language Models.

medRxiv : the preprint server for health sciences·2026
Same author

Study Design Indexing in Transition: A Focused Comparison of manual NLM Indexing vs. Transformer-based Automated Models.

medRxiv : the preprint server for health sciences·2026
Same author

METLIN 960 K: An Empirical Tandem Mass Spectrometry Data Resource.

Analytical chemistry·2026
Same author

Untargeted Multiple Reaction Monitoring.

Analytical chemistry·2026
Same author

Advancing Whole-Person Health through Informatics: A Narrative Review of Knowledge Resources for Complementary and Integrative Health.

The Journal of nutrition·2026

Related Experiment Video

Updated: Jun 29, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K

Automatic categorization of self-acknowledged limitations in randomized controlled trial publications.

Mengfei Lan1, Mandy Cheng2, Linh Hoang1

  • 1School of Information Sciences, University of Illinois Urbana-Champaign, 501 Daniel Street, Champaign, 61820, IL, USA.

Journal of Biomedical Informatics
|March 28, 2024
PubMed
Summary

Researchers developed natural language processing (NLP) methods to automatically detect and categorize study limitations in randomized controlled trials (RCTs). This tool enhances scientific transparency by identifying reporting issues in publications.

Keywords:
Large language modelsNatural language processingRandomized controlled trialsReporting qualitySelf-acknowledged limitationsText classification

More Related Videos

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.4K
Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.5K

Related Experiment Videos

Last Updated: Jun 29, 2025

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

7.5K
Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties
12:55

Multimodal Protocol for Assessing Metacognition and Self-Regulation in Adults with Learning Difficulties

Published on: September 27, 2020

8.4K
Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index
06:55

Inverse Probability of Treatment Weighting Propensity Score using the Military Health System Data Repository and National Death Index

Published on: January 8, 2020

14.5K

Area of Science:

  • Medical Informatics
  • Clinical Trials Research
  • Natural Language Processing

Background:

  • Acknowledging study limitations is vital for scientific transparency and progress.
  • Current reporting of limitations in scientific publications is often insufficient.
  • Natural language processing (NLP) offers potential for automated checks to improve research transparency.

Purpose of the Study:

  • To develop a dataset and NLP methods for detecting and categorizing self-acknowledged limitations in randomized controlled trial (RCT) publications.
  • To improve the accuracy and efficiency of identifying and classifying study limitations.
  • To enable large-scale analysis of limitation reporting in clinical research.

Main Methods:

  • Created a data model with 15 categories and 24 sub-categories for limitation types.
  • Annotated 1090 limitation instances across 200 full-text RCT publications.
  • Fine-tuned BERT-based models (PubMedBERT) for sentence and type classification, incorporating data augmentation (EDA, PromDA).
  • Applied the best-performing model to approximately 12,000 RCT publications.

Main Results:

  • The PubMedBERT model for limitation sentence classification achieved an F1 score of 0.821.
  • The best-performing limitation type classification model (PubMedBERT with PromDA) reached an F1 score of 0.7, a 2.7 percentage point improvement.
  • Significant improvements in classification accuracy were observed with fine-tuning and data augmentation techniques.

Conclusions:

  • Developed NLP models can support automated screening tools for journals to identify reporting issues.
  • Automatic extraction of limitations can enhance peer review and evidence synthesis.
  • This approach facilitates better searching and aggregation of evidence from clinical trial literature.