FlowCron - 通过将Globus包裹成一个功能即服务的功能来增加对HPC的访问.
Dimitrios Bellos1, James Allsopp2, Elaine M L Ho1
1The Rosalind Franklin Institute, Rutherford Appleton Laboratory, Harwell Campus, Didcot, England, OX11 0FA, UK.
Wellcome open research
|March 10, 2025
概括
FlowCron简化了研究人员的高性能计算 (HPC) 访问. 这种开源系统可以在最低限度的用户培训下对HPC设施进行数据分析,从而加速科学发现.
科学领域:
- 计算生物学 计算生物学
- 科学计算科学计算
- 低温电子显微镜 (cryo-EM) 是一种低温电子显微镜.
背景情况:
- 由于复杂的设置和维护,许多研究人员无法利用高性能计算 (HPC).
- 这限制了科学吞吐量和及时数据分析,特别是在密集计算的领域,如冷EM.
- 简化HPC接入对于提高科学质量和投资回报至关重要.
研究的目的:
- 介绍FlowCron,这是一个可访问的技术,研究人员可以分析HPC设施的数据.
- 为了降低HPC利用的进入障碍,使得科学发现更快.
- 提高HPC数据处理管道的可靠性和易用性.
主要方法:
- FlowCron将管道安装和维护从用户转移到HPC系统管理员.
- 该系统将Globus和cron连接起来,创建了一个开源解决方案,需要最小的管理支持.
- 用户通过Globus网站启动分析,通过自动数据加密,上传,分析和返回.
主要成果:
- FlowCron显著增加了研究人员对HPC资源的可访问性.
- 该系统简化了HPC数据分析管道的设置并提高了其可靠性.
- 在HPC集群中共同的软件依赖性确保了广泛的适用性.
结论:
- FlowCron使研究人员能够利用HPC以最少的培训来加速数据分析.
- 这种方法提高了科学吞吐量,并提高了数据密集型领域的研究质量.
- 这种开源,低管理成本的系统为民主化HPC接入提供了一种实际解决方案.
相关概念视频
02:21Globular and Fibrous Proteins
4.0K
4.0K
01:27Globular Proteins
7.0K
In organisms, proteins are the most abundant macromolecules. They act as the building blocks of life and play various crucial roles in the body. Proteins can be broadly classified into two distinct subtypes based on their shape and solubilities: globular proteins and fibrous proteins.
Globular proteins serve many important physiological functions, such as acting as enzymes, cellular messengers, and molecular transporters. These roles often require the proteins to be soluble in the aqueous...
Globular proteins serve many important physiological functions, such as acting as enzymes, cellular messengers, and molecular transporters. These roles often require the proteins to be soluble in the aqueous...
7.0K
01:28Field Application of Global Positioning System
23
The Global Positioning System (GPS) has become an indispensable tool in fieldwork, offering unparalleled precision and efficiency for surveying, navigation, and infrastructure development. By harnessing signals from a constellation of satellites, GPS receivers determine the location of objects with remarkable speed and accuracy, often completing calculations within a second.Advantages of Modern GPS TechnologyContemporary GPS receivers are designed to meet the practical demands of field...
23
01:30Introduction to Global Positioning System
44
The Global Positioning System (GPS) revolutionized positioning on Earth, providing precise location data through satellite ranging. The GPS system was developed in 1978 by the U.S. Department of Defense for military use, and it became available for civilian applications in 1983, transforming fields including navigation, fleet management, and time synchronization for telecommunications systems.GPS consists of satellites in medium Earth orbit, about 20,200 kilometers above the surface,...
44
01:31Hybridoma Technology
13.9K
Hybridoma technology is used for the large-scale production of monoclonal antibodies. Monoclonal antibodies bind to only a single antigenic determinant or epitope. Such antibodies are used in research, diagnostics, and disease therapy. The hybridoma technology established in 1975 by Georges Köhler and Cesar Milstein was awarded the Nobel Prize in Medicine in 1984 for revolutionizing research and therapy.
Hybridoma Selection
Commonly used fusion techniques — electroporation,...
Hybridoma Selection
Commonly used fusion techniques — electroporation,...
13.9K
01:26Singularity Functions for Shear
116
In structural analysis, singularity functions are crucial in simplifying the representation of shear forces in beams under discontinuous loading. These functions describe discontinuous variations in shear force across a beam with varying loads by using a single mathematical expression, regardless of the complexity of the loading conditions. The singularity functions are derived from creating a free-body diagram of the beam and then making conceptual cuts at specific points to examine the...
116