沟通高效 准确的统计估计 统计估计
Jianqing Fan1, Yongyi Guo1, Kaizheng Wang2
1Department of ORFE, Princeton University.
Journal of the American Statistical Association
|June 22, 2023
概括
本研究介绍了分布式数据的通讯高效准确统计估计器 (CEASE). 这些算法提供了高效和准确的统计推断,克服了分布式系统中的通信和隐私挑战.
科学领域:
- 分布式系统 分布式系统
- 统计推理 统计推理
- 优化算法 优化算法
背景情况:
- 传统的统计推断在分布式数据环境中面临挑战,原因是通信成本和隐私问题.
- 现有的方法可能不适合大规模分布式数据集,需要高效的处理.
研究的目的:
- 开发和研究用于分布式数据分析的新型通信高效准确统计估计器 (CEASE).
- 通过提出代算法来优化分布式环境中的传统方法的局限性.
主要方法:
- 实现CEASE通过代算法进行分布式优化.
- 节点机器执行并行计算,并与中央处理器通信以进行聚合更新.
- 算法适应损失函数相似性,并从较大的本地样本大小中获益.
主要成果:
- 在一般条件下,CEASE算法证明了快速收和线性收的保证.
- 优化错误的收缩率被明确地呈现出来,显示了对本地样本大小的依赖.
- 每次代实现了更好的统计准确性,统计效率可以在有限的步骤中实现.
结论:
- CEASE算法为分布式数据推断提供了一种沟通效率高,统计准确的方法.
- 提出的方法克服了传统的局限性,并提供了通过数值实验验证的卓越性能.
- 确定了单步CEASE估计器统计效率的条件.
相关概念视频
Statistical Analysis: Overview
6.7K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
6.7K
What are Estimates?
5.3K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates.
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
5.3K
Estimation of the Physical Quantities
4.5K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
4.5K
Distributions to Estimate Population Parameter
4.1K
The accurate values of population parameters such as population proportion, population mean, and population standard deviation (or variance) are usually unknown. These are fixed values that can only be estimated from the data collected from the samples. The estimates of each of these parameters are sample proportion, the sample mean, and sample standard deviation (or variance). To obtain the values of these sample statistics, data are required that have particular distribution and central...
4.1K
Statistical Methods for Analyzing Epidemiological Data
426
Epidemiological data primarily involves information on specific populations' occurrence, distribution, and determinants of health and diseases. This data is crucial for understanding disease patterns and impacts, aiding public health decision-making and disease prevention strategies. The analysis of epidemiological data employs various statistical methods to interpret health-related data effectively. Here are some commonly used methods:
426
Contaminants and Errors
120
Effective sample preparation is crucial for accurate and reliable laboratory analysis. During this process, two significant sources of error can arise: concentration bias from improper sample splitting and contamination caused by methods used to reduce particle size, such as grinding or homogenization. Identifying and minimizing these potential errors is crucial to ensuring the validity of the analysis.
Another key consideration is determining the appropriate number of samples required to...
Another key consideration is determining the appropriate number of samples required to...
120


