深度强化学习数据收集用于隐藏马尔科夫模型的贝叶斯推理
1Department of Electrical and Computer Engineering at Northeastern University.
概括
本研究介绍了一种贝叶斯看头方法,用于在隐藏马尔科夫模型 (HMM) 中有效收集数据. 该方法优化了长期推断性能,在不确定的环境中提高了准确性.
科学领域:
- 动态系统建模动态系统建模
- 机器学习 机器学习
背景情况:
- 隐藏的马尔科夫模型 (HMM) 对于分析复杂的,部分观察到的系统至关重要.
- 目前对HMMs的数据收集通常是低效的,特别是在随机域中昂贵的数据.
研究的目的:
- 引入一个新的贝叶斯看头数据收集方法,用于HMM推理.
- 在不确定性下优化数据收集策略,以改善长期模型性能.
主要方法:
- 开发了贝叶斯看头政策,使用信念状态来捕捉状态和模型的联合分布.
- 采用深度强化学习来通过离线轨迹模拟近似最佳贝叶斯解决方案.
- 创建了一个可适应实时执行和动态调整的预训练政策.
主要成果:
- 在三个不同的系统中,在推断准确度和稳定性方面取得了显著的改进.
- 在数据有限和不确定的环境中展示了该方法的有效性.
- 验证了该方法支持各种推断目标 (点,分布,因果) 的能力.
结论:
- 拟议的贝叶斯看头方法为HMM推理提供了更有效和更强大的数据收集方法.
- 该框架通过考虑数据收集决策的长期影响来提高模型性能.
- 基于深度强化学习的政策为现实世界的应用提供了实用和适应性的解决方案.
相关概念视频
Data Collection by Experiments
23.6K
Data collection is a systematic method of obtaining, observing, measuring, and analyzing accurate information. An experimental study is a standard method of data collection that involves the manipulation of the samples by applying some form of treatment prior to data collection. It refers to manipulating one variable to determine its changes on another variable. The sample subjected to treatment is known as “experimental units.”
An example of the experimental method is a public...
An example of the experimental method is a public...
23.6K
Data Collection by Observations
11.6K
Data collection refers to a systematic way of obtaining, observing, measuring, and analyzing accurate information. Observational studies are one of the most widely used methods of data collection. It involves collecting data by observing the behavior and physical characteristics of a sample without making any modifications to the sample.
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
An astronomer viewing the motion and brightness of stars in the sky and recording the data is an example of observational data collection. A botanist recording...
11.6K
Data Collection III
2.5K
The physical assessment examines the patient for objective data that defines the patient's condition, and aids in formulating the nursing care plan. The purpose of physical assessment is a health status appraisal, which includes identifying health problems, and establishing a database for nursing intervention.
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...
The principles to begin the physical assessment include conducting a comprehensive or problem-related history in a quiet, well-lit room, emphasizing privacy and comfort for the...
2.5K
Data Collection II
6.9K
The nursing history captures and records the patient's health status, so that a care plan evolves to meet the patient's individual needs. The nursing health history is a part of the initial assessment. A comprehensive history covers all health dimensions and plays a significant role in the assessment process. A comprehensive history includes the patient's biographical information, reasons for seeking health care, expectations, present and past health history, medications, and...
6.9K
Model Approaches for Pharmacokinetic Data: Distributed Parameter Models
43
Pharmacokinetic models are mathematical constructs that represent and predict the time course of drug concentrations in the body, providing meaningful pharmacokinetic parameters. These models are categorized into compartment, physiological, and distributed parameter models.
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
The distributed parameter models are specifically designed to account for variations and differences in some drug classes. This model is particularly useful for assessing regional concentrations of anticancer or...
43
Data Collection I
5.9K
Data collection gathers information needed to make accurate judgments about a patient's present condition. During a health history interview, subjective data is collected from the patient, their caregivers, or family members, and objective data is collected through observations and physical assessment. Patients are the primary source of subjective data. Thus information gathered from patients through interviews, observations, and physical examination is primary data. Secondary sources of...
5.9K


