使用深度强化学习进行噪声减轻结构的自主设计
Semere B Gebrekidan1, Steffen Marburg1
1Chair of Vibroacoustics of Vehicles and Machines, Technical University of Munich, Garching 85748, Germany.
The Journal of the Acoustical Society of America
|July 3, 2024
概括
本研究使用深度强化学习自主设计降噪结构. 双深Q网络方法在没有先前数据的情况下学习有效的配置,从而实现通用宽带噪声降低.
科学领域:
- 计算工程是指计算机工程.
- 声学超材料是一种声学超材料.
- 机器学习 机器学习
背景情况:
- 设计有效的降噪结构往往需要广泛的模拟和事先的知识.
- 结构设计的传统深度学习方法通常需要标记数据,这限制了它们的适用性.
- 自主设计为发现新型声学解决方案提供了潜在的解决方案.
研究的目的:
- 探索深度强化学习 (DRL) 的应用,用于噪音减轻结构的自主设计.
- 调查深度Q网络和双深度Q网络在实现宽带噪声减轻方面的有效性.
- 证明DRL算法在不同的声环境 (反射和传输) 中的概括性.
主要方法:
- 使用深度Q网络 (DQN) 和双深度Q网络 (DDQN) 来优化材料分布.
- 使用基于像素的输入用于DDQN,在没有先前知识的情况下学习降噪策略.
- 实现统一的超参数和网络架构,以解决反射和传输问题.
- 将DRL算法的性能与遗传算法的性能进行比较.
主要成果:
- 在不需要标记数据的情况下,DDQN成功学习了用于宽带降噪的材料分布.
- DRL方法在不同的声环境 (传输和反射) 中显示了可通用性.
- 与遗传算法进行比较表明,在复杂的场景中,一般化设计的可能性很大,尽管DRL显示出趋向于局部最大值的趋势.
结论:
- 使用DRL,特别是DDQN的自主设计提供了一种强大的,无知识的方法来创建减噪结构.
- 该方法对声学的普遍学习有希望,可以适应各种形状和环境.
- 进一步的研究可以探索超参数优化和局部最大值预测的缓解,以提高性能.
相关概念视频
Role of Shaping in Operant Conditioning
290
Shaping is a technique used in operant conditioning to train complex behaviors by rewarding successive approximations toward the target behavior. This method is necessary because organisms are unlikely to perform complex behaviors spontaneously. Instead, shaping breaks down the desired behavior into small, manageable steps.
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
The steps involved in shaping begin with reinforcing any response that resembles the desired behavior. For example, parents might praise a child for picking up one toy. As...
290
PD Controller: Design
215
In automotive engineering, car suspension systems often employ Proportional Derivative (PD) controllers to enhance performance. PD controllers are utilized to adjust the damping force in response to road conditions. A controller, acting as an amplifier with a constant gain, demonstrates proportional control, with output directly mirroring input.
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
Designing a continuous-data controller requires selecting and linking components like adders and integrators, which are fundamental in Proportional,...
215


