Core Scientific Dataset Model: A lightweight and portable model and file format for multi-dimensional scientific data

Area of Science:

• Data Science
• Scientific Computing
• Information Science

Background:

• Current scientific data exchange methods can be cumbersome and lack standardization.
• Need for a lightweight, portable, and versatile standard for handling complex datasets.

Purpose of the Study:

• To introduce the Core Scientific Dataset (CSD) model.
• To demonstrate its utility for intra- and interdisciplinary scientific data exchange using JSON serialization.
• To provide a foundation for developing advanced portable scientific dataset file standards.

Main Methods:

• Developed a data model supporting p-component dependent variables discretely sampled in a d-dimensional space.
• Ensured data sampling occurs on an orthogonal grid (regular or rectilinear).
• Utilized JavaScript Object Notation (JSON) for data serialization, ensuring portability and ease of use.

Main Results:

• The CSD model effectively encapsulates sampled data values and essential metadata.
• Supports datasets with correlated variables sampled on the same grid.
• Demonstrates lightweight, portable, and versatile characteristics for scientific data.

Conclusions:

• The CSD model offers a standardized, efficient approach to scientific data exchange.
• It serves as a foundational, re-usable component for future data file standards.
• Promotes enhanced data sharing and collaboration across scientific domains.