Related Experiment Video
Updated: Jun 5, 2026

Informatic Analysis of Sequence Data from Batch Yeast 2-Hybrid Screens
Published on: June 28, 2018
An overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics
1Computational Biology and Bioinformatics Group, Pacific Northwest National Laboratory, Richland, Washington 99352, USA. ronald.taylor@pnl.gov
Background:
Bioinformatics researchers are now confronted with analysis of ultra large-scale data sets, a problem that will only increase at an alarming rate in coming years. Recent developments in open source software, that is, the Hadoop project and associated software, provide a foundation for scaling to petabyte scale data warehouses on Linux clusters, providing fault-tolerant parallelized analysis on such data using a programming style named MapReduce.
Description:
An overview is given of the current usage within the bioinformatics community of Hadoop, a top-level Apache Software Foundation project, and of associated open source software projects. The concepts behind Hadoop and the associated HBase project are defined, and current bioinformatics software that employ Hadoop is described. The focus is on next-generation sequencing, as the leading application area to date.
Conclusions:
Hadoop and the MapReduce programming paradigm already have a substantial base in the bioinformatics community, especially in the field of next-generation sequencing analysis, and such use is increasing. This is due to the cost-effectiveness of Hadoop-based analysis on commodity Linux clusters, and in the cloud via data upload to cloud vendors who have implemented Hadoop/HBase; and due to the effectiveness and ease-of-use of the MapReduce method in parallelization of many data analysis algorithms.
Related Concept Videos
Issues And Trends In Healthcare Delivery System
Cost Containment
Payment for healthcare services has historically promoted adoption of costly and often unnecessary or inefficient...
Overview of Biostatistics in Health Sciences
Applications of Molecular Taxonomy
Biostatistics: Overview
Discrete variables are...
Applications Of NMR In Biology
The...
Statistical Software for Data Analysis and Clinical Trials

