Federated repositories of X-ray diffraction images

Area of Science:

• Structural Biology
• Crystallography
• Data Archiving

Background:

• Raw X-ray diffraction data is essential for validating and improving archived protein structures.
• The large size of diffraction data poses challenges for centralized storage solutions like the Protein Data Bank.
• Current data archiving practices lack comprehensive raw data storage, hindering reproducibility and methods development.

Purpose of the Study:

• To propose and describe a federated approach for archiving and curating raw X-ray diffraction data.
• To present a cost-effective and easily deployable repository solution for institutional use.
• To ensure the long-term persistence and accessibility of valuable crystallographic datasets.

Main Methods:

• Implementation of a federated data storage system utilizing institutional repositories.
• Overlaying a discovery service for efficient data retrieval.
• Deployment of Fedora open-source database software with data-annotation and deposition tools.
• Assigning unique and persistent handles to datasets and metadata for searchability.

Main Results:

• A simple, inexpensive, and easily deployable repository solution for raw X-ray diffraction data.
• Federated repositories ensure data persistence through stable institutional funding.
• A mechanism for simple search and retrieval via web interfaces using persistent handles.

Conclusions:

• The federated approach effectively addresses the challenges of storing large X-ray diffraction datasets.
• This solution enhances data validation, reproducibility, and the development of new analytical methods in crystallography.
• Ensuring the availability of raw data is vital for the advancement of structural biology research.