有效的轻量级隐私数据异常检测解决方案,具有强大的聚合能力
Jiateng Zhao1,2,3, Bin Wen4,5,6, Jiashuai Yang7,8,9
1Key Laboratory of Data Science and Smart Education, Ministry of Education (Hainan Normal University), Haikou, 571158, China. 202312083900002@hainnu.edu.cn.
Scientific reports
|November 27, 2025
概括
这项研究引入了一个强大的联合学习框架,用于检测私人文本中的异常. 它平衡了隐私,效率和准确性与模型中毒攻击.
科学领域:
- 人工智能的人工智能
- 机器学习 机器学习
- 自然语言处理自然语言处理.
背景情况:
- 联合学习 (FL) 在检测隐私敏感文本中的异常方面存在挑战,原因是模型中毒和效率需求.
- 现有的方法往往很难在FL设置中平衡稳定性,计算成本和隐私保护.
研究的目的:
- 在联合学习环境中开发一个完整的框架,用于在隐私敏感文本中进行强大和高效的异常检测.
- 提高FL对模型中毒攻击的弹性,同时降低推断成本.
主要方法:
- 开发了一种早期退出的RoBERTa分类器 (E2-RoBERTa),具有多阶段的退出和时空卷积LSTM融合模块.
- 提出了一个强大的联合分层聚合策略 (RFLA),包括缩小维度,密度聚类和基于Mahalanobis的权重,以实现服务器端的弹性.
主要成果:
- E2-RoBERTa实现了高检测准确度,实验显示SMS数据上的[公式:参见文本].
- 与Krum,Trimmed Mean和Median相比,RFLA在显著的恶意客户百分比下 (20-50%) 显示出更高的准确性和稳定性.
- 早期退出机制将平均推断时间减少了大约17%.
结论:
- 综合框架有效地平衡了隐私保护,对模型中毒的稳定性和计算效率.
- 拟议的E2-RoBERTa和RFLA提供了一个实用的解决方案,用于在联合设置中检测隐私文本异常.
- 这种方法支持在敏感数据环境中部署安全有效的异常检测系统.
相关概念视频
Unusual Results
3.7K
Unusual results are those that have a very low chance of occurring. Unusual results can be identified using probabilities and the range rule of thumb. In problems involving probability, unusual results can be observed in 2 instances – an unusually high number of successes or an unusually low number of successes.
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
According to the range rule of thumb, any value above or below two standard deviations, 2σ from the mean, μ is considered unusual.
Maximum unusual value =...
3.7K
Detection of Gross Error: The Q Test
6.8K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.8K
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
Mass Analyzers: Overview
1.5K
The mass analyzer is a crucial component of the mass spectrometer. In the ionization chamber, the vaporized sample is bombarded with a high-energy electron beam to generate a radical cation and further fragment into neutral molecules, radicals, and cations. A series of negatively charged accelerator plates accelerate the cations into the mass analyzer. The mass analyzer separates ions according to their mass-to-charge (m/z) ratios and then directs them to the detector. The common types of mass...
1.5K
Aggregates Classification
953
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
953
Unsoundness of Aggregate due to Volume Change
337
Unsoundness in aggregates due to volume changes is primarily caused by the physical alterations aggregates undergo, such as freezing and thawing, thermal changes, and wetting and drying. Unsound aggregates, when subjected to these changes, result in volume change upon disintegration. This, in turn, contributes to the deterioration of concrete, including scaling, pop-outs, and cracking. Particular types of aggregates, such as porous flints, cherts, and those containing clay minerals, are...
337


