Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

BioCreAtIvE task 1A: gene mention finding evaluation.

Alexander Yeh1, Alexander Morgan, Marc Colosimo

  • 1The MITRE Corporation, 202 Burlington Road, Bedford, MA 01730, USA. asy@mitre.org

BMC Bioinformatics
|June 18, 2005
PubMed
Summary

BioCreAtIvE developed a standard for evaluating biological text mining systems. Task 1A successfully identified gene mentions with over 80% F-measure, though gene name complexity presents challenges.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

The Promise and Challenge of Large Language Models for Pharmacovigilance.

Drug safety·2025
Same author

A Comparison of Approaches for Motion Artifact Removal from Wireless Mobile EEG During Overground Running.

Sensors (Basel, Switzerland)·2025
Same author

Tailoring of Self-Healable Polydimethylsiloxane Films for Mechanical Energy Harvesting.

ACS applied energy materials·2024
Same author

Comparison of Impact Accelerations During Performance of Common Ballet Maneuvers: A Pilot Study.

Journal of dance medicine & science : official publication of the International Association for Dance Medicine & Science·2023
Same author

Intrapulmonary shunting is a key contributor to hypoxia in COVID-19: An update on the pathophysiology.

PloS one·2022
Same author

Overview of the COVID-19 text mining tool interactive demonstration track in BioCreative VII.

Database : the journal of biological databases and curation·2022

Area of Science:

  • Bioinformatics and Computational Biology
  • Natural Language Processing in Biology
  • Biomedical Text Mining

Background:

  • The exponential growth of biological literature necessitates advanced information retrieval methods.
  • Evaluating biological text mining systems is challenging due to a lack of standardized comparison metrics.
  • The Protein Design Group at CNB-CSIC initiated BioCreAtIvE to address this standardization gap.

Purpose of the Study:

  • To establish an open, common evaluation framework for biological text mining systems (BioCreAtIvE).
  • To report on the performance of Task 1A, focusing on the identification of gene and related entity mentions in text.
  • To provide a foundational task for building more complex biological text mining applications.

Main Methods:

Related Experiment Videos

  • Development of BioCreAtIvE (Critical Assessment for Information Extraction in Biology) as a standardized evaluation platform.
  • Task 1A focused on the 'finding mentions' task, a fundamental component of biological text mining.
  • Utilized data and evaluation software provided by the National Center for Biotechnology Information (NCBI).

    • Main Results:

    • Fifteen teams participated in Task 1A of the BioCreAtIvE evaluation.
    • Several participating teams achieved an F-measure exceeding 80%, indicating high performance in gene mention identification.
    • Systems developed for Task 1A showed mixed success when applied to other BioCreAtIvE tasks.

    Conclusions:

    • The achieved F-measure scores above 80% represent a significant advancement in biological entity recognition.
    • Performance in biological text mining, specifically gene name recognition, lags behind other domains like newswire.
    • The inherent complexity and length of gene names contribute to the challenges in achieving top-tier performance compared to person or organization names.