机器取消学习:分类学,指标,应用,挑战和前景
概括
机器取消学习 (MU) 允许从机器学习模型中删除数据,而不需要完全重新训练,解决被遗忘的权利. 这项调查映射了MU算法,验证方法和应用程序,重点关注大型语言模型.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 数据 隐私 数据 隐私 数据
背景情况:
- 个人数字数据是一个关键资产,需要强有力的隐私保护.
- "被遗忘权" (RTBF) 授权个人要求删除数据.
- 现有的机器学习 (ML) 实践很难有效地消除数据在请求后的影响.
研究的目的:
- 为快速发展的机器取消学习 (MU) 领域提供全面的调查.
- 为了分类MU算法,讨论近似的失学,以及详细的验证/评估指标.
- 探索MU在大型语言模型 (LLM) 中的应用,并确定未来的研究方向.
主要方法:
- 广泛的文献审查和现有关于机器失学研究的综合研究.
- 在集中和分布式环境中开发一个细粒度的分类法,用于忘记学习的算法.
- 分析近似的失学,验证技术和特定应用的挑战.
主要成果:
- 一个结构化的概述机器取消学习技术,包括它们的优点和弱点.
- 确定关键的挑战和建议的解决方案,以实施MU,特别是在LLMs.
- 讨论针对失学过程的潜在攻击及其缓解方法.
结论:
- 机器取消学习对于在AI时代维护数据隐私权至关重要.
- 需要进一步的研究来完善MU方法,增强验证,并确保放弃学习的过程.
- 这项调查是机器取消学习的研究人员和从业人员的基础资源.
相关概念视频
01:26Classification of Systems-I
Linearity is a system property characterized by a direct input-output relationship, combining homogeneity and additivity.
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
Homogeneity dictates that if an input x(t) is multiplied by a constant c, the output y(t) is multiplied by the same constant. Mathematically, this is expressed as:
01:31Classification of Systems-II
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
01:29Aggregates Classification
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...