Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Evolutionary Relationships through Genome Comparisons

Evolutionary Relationships through Genome Comparisons

Genome comparison is one of the excellent ways to interpret the evolutionary relationships between organisms. The basic principle of genome comparison is that if two species share a common feature, it is likely encoded by the DNA sequence conserved between both species. The advent of genome sequencing technologies in the late 20th century enabled scientists to understand the concept of conservation of domains between species and helped them to deduce evolutionary relationships across diverse...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Lightweight multiscale early warning system for influenza A spillovers.

Science advances·2025

Same author

I-ETL: an interoperability-aware health (meta)data pipeline to enable federated analyses.

BMC medical informatics and decision making·2025

Same author

BioGAN: Enhancing Transcriptomic Data Generation with Biological Knowledge.

Bioengineering (Basel, Switzerland)·2025

Same author

Elucidating the causal relationship of mechanical power and lung injury: a dynamic approach to ventilator management.

Intensive care medicine experimental·2025

Same author

Publisher Correction: The ENCODE Imputation Challenge: a critical assessment of methods for cross-cell type imputation of epigenomic profiles.

Genome biology·2025

Same author

Advancing healthcare through data: the BETTER project's vision for distributed analytics.

Frontiers in medicine·2024

Search research articles

Related Experiment Video

Updated: Jan 4, 2026

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Published on: December 7, 2021

PyGMQL: scalable data extraction and analysis for heterogeneous genomic datasets.

Luca Nanni¹, Pietro Pinoli², Arif Canakoglu²

¹Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy. luca.nanni@polimi.it.

BMC Bioinformatics

|November 10, 2019

Summary

PyGMQL is a novel software enabling scalable genomic data analysis. It efficiently processes large datasets and metadata, improving reproducibility for biological research.

Keywords:

Data scalability Distribution transparency Genomic data Python Tertiary data analysis

More Related Videos

A Fast and Quantitative Method for Post-translational Modification and Variant Enabled Mapping of Peptides to Genomes

A Fast and Quantitative Method for Post-translational Modification and Variant Enabled Mapping of Peptides to Genomes

Published on: May 22, 2018

Detecting Somatic Genetic Alterations in Tumor Specimens by Exon Capture and Massively Parallel Sequencing

Detecting Somatic Genetic Alterations in Tumor Specimens by Exon Capture and Massively Parallel Sequencing

Published on: October 18, 2013

Related Experiment Videos

Last Updated: Jan 4, 2026

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Heuristic Mining of Hierarchical Genotypes and Accessory Genome Loci in Bacterial Populations

Published on: December 7, 2021

A Fast and Quantitative Method for Post-translational Modification and Variant Enabled Mapping of Peptides to Genomes

A Fast and Quantitative Method for Post-translational Modification and Variant Enabled Mapping of Peptides to Genomes

Published on: May 22, 2018

Detecting Somatic Genetic Alterations in Tumor Specimens by Exon Capture and Massively Parallel Sequencing

Detecting Somatic Genetic Alterations in Tumor Specimens by Exon Capture and Massively Parallel Sequencing

Published on: October 18, 2013

Area of Science:

Genomics
Bioinformatics
Data Management

Background:

Analyzing large, heterogeneous genomic datasets presents challenges in efficiency and reproducibility.
Existing tools struggle to scale for thousands of experiments and lack robust metadata handling.

Purpose of the Study:

To introduce PyGMQL, a software tool for manipulating region-based genomic files and metadata.
To enable scalable and reproducible genomic data analysis pipelines.

Main Methods:

PyGMQL is built on the GMQL genomic big data management system and Apache Spark.
It offers expressive functions for region and metadata manipulation, supporting interactive analysis in Python.
Features include data interoperability, distribution transparency, and query outsourcing.

Main Results:

PyGMQL scales to arbitrary clusters, processing millions of regions from thousands of files.
It integrates scalable data extraction with native Python support for analysis and visualization.
Demonstrated improved interoperability and addressed the mismatch between set-oriented queries and Python programming.

Conclusions:

PyGMQL is an effective tool for tertiary data extraction and analysis pipelines.
Its expressiveness, performance, reproducibility, and scalability were demonstrated through complex biological data scenarios.