Scientific data exchange: a schema for HDF5-based storage of raw and analyzed data

Francesco De Carlo1, Doga Gürsoy1, Federica Marone2

  • 1Advanced Photon Source, Argonne National Laboratory, 9700 South Cass Avenue, Argonne, IL 60439, USA.

Summary

A new Data Exchange model simplifies sharing data and analysis tools across various X-ray instruments. This technique-focused approach enhances data provenance tracking for improved scientific collaboration.

Related Concept Videos

High-Resolution Mass Spectrometry (HRMS)01:15

High-Resolution Mass Spectrometry (HRMS)

The resolution of a mass spectrometer depends on the efficiency of separating ions with different ion masses. The mass of an atom is approximated to the sum of the masses of protons and neutrons inside, considering the masses of protons and neutrons as equal. However, the masses of the proton (1.6726 × 10−24 g) and neutron (1.6749 × 10−24 g) are not truly equal. There is a minor error in the expression of atomic masses relative to the simplest atom of hydrogen. For...
2.5K
Storage01:23

Storage

A schema is a mental framework that helps individuals organize and interpret information. Schemata, formed from previous experiences, influence how we process new information: how we encode it, the inferences we make, and how we retrieve it. For instance, a schema for what a typical classroom looks like might include desks, a teacher's desk, a whiteboard, and students in such an environment. This expectation helps us quickly understand and navigate new classrooms without needing to analyze...
502
Data Reporting and Recording01:24

Data Reporting and Recording

Reporting and recording are crucial in data documentation. The timely, thorough, and accurate documentation of facts is essential when recording patient data. Failure to record findings during an assessment or interpretation of a problem will result in loss of information and make the patient document unreliable. The reader is left with general impressions if the information is not specific. A recording is documenting data of the individual's health information in a traceable, secure, and...
5.5K
Histogram01:05

Histogram

The histogram is a graphical representation in the x-y form of data distribution in a data set. The horizontal x-axis is labeled with what the data represents (for instance, distance from your home to school). The vertical y-axis is labeled either frequency or relative frequency (or percent frequency or probability).
A histogram graph consists of contiguous (adjoining) boxes. The heights of the bars correspond to frequency values. The graph will have the same shape with respective labels. The...
12.7K
SDS-PAGE01:27

SDS-PAGE

Gel electrophoresis is a method that separates biological macromolecules like nucleic acids or proteins by forcing them to pass through a gel matrix under an electric field.
A variation of gel electrophoresis, termed  polyacrylamide gel electrophoresis (PAGE), is commonly used for separating proteins according to their molecular size by passing them through a polyacrylamide gel. Because of the varying charges associated with amino acid side chains, PAGE can be used to separate intact...
22.3K