Trillion-scale integrated framework for high-throughput materials databases and seamless sharing
Related Experiment Video
Updated: Nov 6, 2026

Discovery and Synthesis Optimization of Isoreticular Al(III) Phosphonate-Based Metal-Organic Framework Compounds Using High-Throughput Methods
Published on: October 6, 2023
Xiaoya Huang1,2,3, Yu Liu4,5,6,7, Shuo Shi1
1Tianmushan Laboratory, Beihang University, Hangzhou, China.
Abstract:
Artificial intelligence is accelerating materials discovery, yet for complex systems such as high-entropy alloys, exhaustive exploration of their immense composition spaces is computationally intractable. Here we propose an integrated framework that enables large-scale exploration with reduced resource demands. Our framework uses stateless parallel computing with message queues and containerization, and a lakehouse architecture with columnar storage and metadata-based cloud sharing. Using this framework, we constructed a ten-trillion-scale database of six-principal-element high-entropy alloys in one week, totaling 17.5 terabytes and encompassing compositions, descriptors, and predicted properties. Compared with distributed frameworks, our approach cuts runtime-memory cost by 45%, storage by 90% versus row-based formats, and accelerates subset queries up to 180 times. A full database search completes in under eight minutes using less than four gigabytes of memory. Screening over 50 billion compositions with experimental validation across two alloy families confirms the practical utility of this framework for data-driven materials discovery.
Related Concept Videos
X-ray Diffraction of Biological Samples
According to Bragg's law, when X-rays strike the sample positioned on a stage, the rays are scattered by the electron clouds around the sample atoms. The X-ray diffraction or scattering is caused by constructive interference of the X-ray waves that reflect off the internal crystal...
High-Resolution Mass Spectrometry (HRMS)
X-ray Crystallography
Diffraction
Diffraction is the change in the direction of travel experienced by an electromagnetic wave when it encounters a physical barrier whose dimensions are comparable to those of the wavelength of the light. X-rays are electromagnetic radiation with wavelengths about as long as the distance between neighboring...
Transmission Electron Microscopy

