Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Signal Sequences and Sorting Receptors01:41

Signal Sequences and Sorting Receptors

Signal sequences are short amino acid sequences that guide newly synthesized proteins to their proper location within the cell. Classical signal sequences are fifteen to sixty amino acids long and present at the N-terminus of a polypeptide chain. Each signal sequence has a conserved segment of basic residues towards their N terminus, a hydrophobic core, and a C-terminus rich in polar residues. The C-terminus also contains a signal cleavage site and features a -3 -1 sequence motif. The -3-1...
Proteins: From Genes to Degradation02:11

Proteins: From Genes to Degradation

Within a biological system, the DNA encodes the RNA, and the nucleotide sequence in the RNA further defines the amino acid sequence in the protein. This is referred to as “The Central Dogma of Molecular Biology” - a term coined by Francis Crick.  Central dogma is a firm principle in biology that defines the flow of genetic information within any life form. The two fundamental steps in central dogma are - transcription and translation.
Transcription is the synthesis of RNA molecules by RNA...
Genomics02:02

Genomics

Genomics is the science of genomes: it is the study of all the genetic material of an organism. In humans, the genome consists of information carried in 23 pairs of chromosomes in the nucleus, as well as mitochondrial DNA. In genomics, both coding and non-coding DNA is sequenced and analyzed. Genomics allows a better understanding of all living things, their evolution, and their diversity. It has a myriad of uses: for example, to build phylogenetic trees, to improve productivity and...
Synthetic Biology02:55

Synthetic Biology

Synthetic biology is an interdisciplinary science that involves using principles from disciplines such as engineering, molecular biology, cell biology, and systems biology. It involves remodeling existing organisms from nature or constructing completely new synthetic organisms for applications such as protein or enzyme production, bioremediation, value-added macromolecule production, and the addition of desirable traits to crops, to name a few.
Golden rice
Golden rice is a genetically modified...
Preclinical Development: Overview01:28

Preclinical Development: Overview

Preclinical development consists of a series of tests that ensure the safety and efficacy of a new therapeutic compound before it is tested in humans. There are four main phases to this process. First, safety pharmacology tests are conducted to ensure the drug does not produce any acutely harmful effects. These tests examine parameters such as bronchoconstriction, cardiac dysrhythmias, blood pressure changes, and ataxia. Next, preliminary toxicological testing is performed to determine the...
Genetic Screens02:46

Genetic Screens

Genetic screens are tools used to identify genes and mutations responsible for phenotypes of interest. Genetic screens help identify individuals or a group of people at risk of developing  genetic diseases and help them with early intervention, targeted therapy, and reproductive options.
Forward genetic screens
Forward or “classical” genetic screens involve creating random mutations in an organism’s DNA using radiation, mutagens, or insertion of additional bases, which result in visible changes...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Goals and strategies for the indexing of publication types and study designs.

Database : the journal of biological databases and curation·2026
Same author

SPIRIT-CONSORT-ELM: Element-Level Assessment of Randomized Controlled Trial Reporting Using Large Language Models.

medRxiv : the preprint server for health sciences·2026
Same author

Study Design Indexing in Transition: A Focused Comparison of manual NLM Indexing vs. Transformer-based Automated Models.

medRxiv : the preprint server for health sciences·2026
Same author

Advancing Whole-Person Health through Informatics: A Narrative Review of Knowledge Resources for Complementary and Integrative Health.

The Journal of nutrition·2026
Same author

Use as directed? A comparison of software tools intended to check rigor and transparency of published work.

PloS one·2026
Same author

Multi-label Sequential Sentence Classification via Large Language Model.

Findings of ACL. EMNLP. Conference on Empirical Methods in Natural Language Processing·2026

Related Experiment Video

Updated: May 26, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

Constructing a semantic predication gold standard from the biomedical literature.

Halil Kilicoglu1, Graciela Rosemblat, Marcelo Fiszman

  • 1Lister Hill National Center for Biomedical Communications, National Library of Medicine, Bethesda, MD, USA. kilicogluh@mail.nih.gov

BMC Bioinformatics
|December 22, 2011
PubMed
Summary

Creating a high-quality gold standard for biomedical relation extraction is challenging but achievable. Iterative refinement of guidelines and semantic criteria improved interannotator agreement for semantic predications.

More Related Videos

A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports
07:35

A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports

Published on: October 13, 2023

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
07:50

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts

Published on: September 20, 2018

Related Experiment Videos

Last Updated: May 26, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports
07:35

A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports

Published on: October 13, 2023

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts
07:50

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts

Published on: September 20, 2018

Area of Science:

  • Biomedical Informatics
  • Natural Language Processing
  • Knowledge Discovery

Background:

  • Semantic relations are crucial for biomedical text mining.
  • Existing gold standards are often domain-specific and lack standardization.
  • A robust gold standard is needed for benchmarking relation extraction systems.

Purpose of the Study:

  • To develop a multi-phase gold standard for semantic relation annotation in biomedical text.
  • To assess interannotator agreement and identify challenges in the annotation process.
  • To create a valuable resource for evaluating relation extraction systems.

Main Methods:

  • Annotated 500 MEDLINE sentences with 1371 semantic predications.
  • Utilized the Unified Medical Language System (UMLS) Metathesaurus and Semantic Network.
  • Conducted a multi-phase study with iterative refinement of annotation guidelines.

Main Results:

  • Initial interannotator agreement was fair to moderate (0.378-0.475).
  • Agreement improved to 0.536 after guideline refinement and semantic equivalence criteria.
  • Agreement reached 0.688 when limited to explicitly provided UMLS concepts and relations.

Conclusions:

  • Achieving acceptable interannotator agreement for semantic annotation is possible through iterative refinement.
  • Mapping text to ontological concepts, especially for biomolecular entities, presents significant challenges.
  • The developed gold standard and lessons learned can broadly benefit biomedical NLP research.