Related Experiment Video
Updated: Apr 28, 2026
13:01
gP2S, an Information Management System for CryoEM Experiments
Published on: June 10, 2021
5.3K
Log-less metadata management on metadata server for parallel file systems
Jianwei Liao1, Guoqiang Xiao1, Xiaoning Peng2
1College of Computer and Information Science, Southwest University of China, Beibei, Chongqing 400715, China.
Thescientificworldjournal
|June 4, 2014
Summary
This study introduces a new metadata management method for distributed file systems. Client file systems back up metadata requests, improving performance and enabling recovery without metadata server logging.
Area of Science:
- Computer Science
- Distributed Systems
- File Systems
Background:
- Metadata management is crucial for parallel and distributed file systems.
- Current methods like logging or journaling on the metadata server (MDS) can be performance bottlenecks and single points of failure.
Purpose of the Study:
- To propose a novel metadata management mechanism for distributed file systems.
- To enhance metadata processing performance and achieve high availability.
- To enable complete metadata recovery in case of MDS failure.
Main Methods:
- Implemented a client-side backup of metadata requests handled by the MDS.
- Offloaded logging/journaling responsibilities from the MDS to the client file systems.
- Utilized client-cached backup logs for metadata recovery.
Main Results:
- Significant improvements in metadata processing speed compared to traditional MDS logging/journaling.
- Enhanced I/O data throughput.
- Demonstrated complete metadata recovery by replaying client-cached logs.
Conclusions:
- The proposed client-side backup mechanism offers a more performant and highly available solution for metadata management in distributed file systems.
- This approach reduces MDS overhead and improves overall system resilience.
- It provides a robust method for metadata recovery upon MDS failure.
Related Concept Videos
02:51Multi-species Conserved Sequences
3.3K
Next-generation sequencing technologies have created large genomic databases of a variety of animals and plants. Ever since the human genome project was completed, scientists studied the genome of primates, mammals, and other phylogenetically distant living beings. Such large-scale studies have provided new insights into the evolutionary relationship between organisms.
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
Although the genome of each species varies greatly from each other, a few sequences are highly conserved. Such conserved...
3.3K
01:15High-Resolution Mass Spectrometry (HRMS)
2.6K
The resolution of a mass spectrometer depends on the efficiency of separating ions with different ion masses. The mass of an atom is approximated to the sum of the masses of protons and neutrons inside, considering the masses of protons and neutrons as equal. However, the masses of the proton (1.6726 × 10−24 g) and neutron (1.6749 × 10−24 g) are not truly equal. There is a minor error in the expression of atomic masses relative to the simplest atom of hydrogen. For...
2.6K
01:21Tandem Mass Spectrometry
3.0K
Tandem mass spectrometry is a technique that uses multiple mass analyzers in series to obtain a higher selectivity and reduce chemical noise during analyte detection. Instruments with multiple analyzers separated by an interaction cell enable secondary fragmentation and selected study of the fragment ions.Secondary fragmentations occur in the interaction cell and can be induced by various factors. Fragmentation induced by collision with inert gases, such as N2, Ar, He, etc., is called...
3.0K
01:18Methods of Documentation I: Source-Oriented Records
1.5K
Source-oriented records, or SOR, are medical record-keeping organized by the data source. The SOR system was first developed in the mid-1900s to organize the growing patient data in hospitals and other healthcare facilities.
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
In an SOR, each discipline involved in patient care maintains a separate medical record section. This record-keeping method enables easy tracking of patient progress and ensures healthcare staff have access to up-to-date information.
Key Attributes include the following:
1.5K
01:27SDS-PAGE
23.1K
Gel electrophoresis is a method that separates biological macromolecules like nucleic acids or proteins by forcing them to pass through a gel matrix under an electric field.
A variation of gel electrophoresis, termed polyacrylamide gel electrophoresis (PAGE), is commonly used for separating proteins according to their molecular size by passing them through a polyacrylamide gel. Because of the varying charges associated with amino acid side chains, PAGE can be used to separate intact...
A variation of gel electrophoresis, termed polyacrylamide gel electrophoresis (PAGE), is commonly used for separating proteins according to their molecular size by passing them through a polyacrylamide gel. Because of the varying charges associated with amino acid side chains, PAGE can be used to separate intact...
23.1K
01:19Mass Spectrometry: Overview
8.2K
Mass spectrometry is an analytical technique used to determine the molecular mass and molecular formula of a compound. The basic principle of mass spectrometry is to generate ions from the analyte molecule and measure these ion abundances against their molecular mass. One common type of ionization, known as electron ionization or EI, bombards the analyte molecules in the gas phase with high-energy electron beams. The electron beams displace an electron from the molecule and leave behind a...
8.2K