The design of a data management system at HEPS

Area of Science:

• * Physics and Materials Science
• * Synchrotron Radiation Technology

Background:

• * The High-Energy Photon Source (HEPS) in China is projected to produce an immense volume of experimental data, estimated at 24 PB per month from its initial 14 beamlines.
• * Future expansion to over 90 beamlines will further increase data generation, necessitating robust data handling capabilities.
• * Ensuring the accuracy, availability, and accessibility of this vast scientific data is critical for research continuity.

Purpose of the Study:

• * To design and describe an effective data management system (DMS) tailored for the HEPS facility.
• * To outline the architecture, data flow, and key technologies of the proposed DMS.
• * To detail the implementation and evaluation of a testbed DMS at the Beijing Synchrotron Radiation Facility.

Main Methods:

• * System architecture design for automated data organization, transfer, storage, distribution, and sharing.
• * Description of data flow from the perspective of both facility users and IT infrastructure.
• * Implementation and testing of a prototype DMS at the 1W1A beamline.

Main Results:

• * A comprehensive DMS architecture has been designed to manage HEPS experimental data.
• * Key techniques for efficient data handling have been identified and integrated.
• * A successful testbed deployment at the Beijing Synchrotron Radiation Facility demonstrates the system's feasibility.

Conclusions:

• * An effective DMS is crucial for managing the large-scale data generated by advanced facilities like HEPS.
• * The designed system automates critical data management processes, ensuring data integrity and accessibility.
• * The testbed results validate the proposed DMS approach for future deployment at HEPS.