网络菌体:用于域驱动分布式大数据系统的参考架构
1School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.
Frontiers in big data
|November 20, 2024
概括
网络,一个去中心化的大数据 (BD) 参考架构,通过提高性能,可用性和可修改性来增强系统开发. 这种领域驱动的方法解决了企业中 BD 采用挑战,尽管它需要技术专业知识.
科学领域:
- 计算机科学 计算机科学
- 数据科学数据科学数据科学
- 软件工程 软件工程 软件工程
背景情况:
- 数字设备和产品的扩散导致了大数据 (BD) 的时代,压倒了传统的数据系统.
- 许多公司都在努力实施大数据系统,估计项目失败率为80%.
- 由于传统分析和存储的局限性,现有的大数据系统往往无法充分利用数据的全部潜力.
研究的目的:
- 介绍Cybermycelium,一个域驱动的去中心化大数据参考架构 (RA).
- 促进企业中大数据系统的开发和采用.
- 为解决大数据系统实施中的关键挑战提供验证的解决方案.
主要方法:
- 根据实证基础的参考架构的指导方针开发了Cybermycelium.
- 通过在一家大型国际公司的现实世界实施来评估架构.
- 使用架构权衡分析方法 (ATAM) 进行评估.
主要成果:
- 网络菌体实现了关键的架构品质:性能 (<1000毫秒的响应时间),可用性 (通过事件经纪人和断路) 和可修改性 (快速服务部署).
- 原型有效地处理数据处理,可扩展性和特定领域的要求.
- 在大型国际公司环境中证明了成功的应用.
结论:
- 基于域驱动的Cybermycelium分布式方法提供了比单体架构更好的可扩展性和可维护性.
- 实施事件骨干和服务网格组件需要大量的技术专业知识.
- 网络菌提供了一种经过验证的参考架构,以帮助企业采用大数据技术.
相关概念视频
Distribution Reliability and Automation
105
Distribution reliability in electrical power systems is critical for ensuring an uninterrupted power supply to consumers at minimal cost. According to IEEE Standard Terms, reliability is the probability that a device will function without failure over a specified time period or amount of usage. For electric power distribution, this translates to maintaining continuous power supply and addressing customer concerns over power outages. Several indices, as defined by IEEE Standard 1366-2012, are...
105
Distributed Loads
511
Distributed loads are a common type of load that engineers and scientists encounter in various practical situations. Distributed loads often refer to a type of load spread over a surface or a structure and can be modeled as continuous force per unit area.
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
For example, consider a bookshelf filled with books stacked vertically adjacent to each other. The weight of the books is evenly distributed over the length of the shelf. As a result, the pressure at different locations on the surface of the...
511
Distributed Loads: Problem Solving
624
Beams are structural elements commonly employed in engineering applications requiring different load-carrying capacities. The first step in analyzing a beam under a distributed load is to simplify the problem by dividing the load into smaller regions, which allows one to consider each region separately and calculate the magnitude of the equivalent resultant load acting on each portion of the beam. The magnitude of the equivalent resultant load for each region can be determined by calculating...
624
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
58
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
58
Transformers in Distribution System
98
Transformers in distribution systems can be broadly categorized into distribution substation transformers and other distribution transformers. They are crucial for stepping down high transmission voltages to levels suitable for distribution and end-user applications.
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
Distribution substation transformers come in various ratings and typically use mineral oil for insulation and cooling. To prevent moisture and air from entering the oil, some transformers use an inert gas like nitrogen to fill the...
98
Data: Types and Distribution
690
In biostatistics, data are the observations collected for analysis. There are two main types: parametric and non-parametric. Parametric data, which include continuous (e.g., weight) and discrete numerical data (e.g., number of tablets), assume a particular distribution pattern, often the normal distribution. Non-parametric data do not adhere to a specific distribution and typically comprise nominal (e.g., gender) and ordinal categorical data (e.g., pain scale ratings).
Distributions in...
Distributions in...
690


