半监督的政策之外的强化学习和价值估计,用于动态处理制度
Aaron Sonabend-W1, Nilanjana Laha2, Ashwin N Ananthakrishnan3
1Department of Biostatistics, Harvard University, Boston, USA.
概括
本研究引入了一种半监督学习 (SSL) 方法,以改善动态治疗方案的强化学习 (RL). 它有效地使用有限的标记数据和大量的未标记数据,从临床笔记中估计患者的结果.
科学领域:
- * 计算统计和机器学习应用于医疗保健.
- * 开发用于个性化医疗的先进算法.
背景情况:
- *强化学习 (RL) 显示出动态治疗方案的潜力,但依赖于准确的健康结果数据.
- * 临床注释通常包含结果信息,但手动提取资源密集,导致小标记数据集.
- * 现有的方法在有限的标记数据上扎,以训练有效的RL模型.
研究的目的:
- * 开发一种半监督学习 (SSL) 方法,用于动态治疗方案中的强化学习 (RL).
- * 为了利用具有观察结果的小标记数据集和具有结果替代品的大型未标记数据集.
- * 解决将SSL泛化为动态处理方案的挑战,包括未知特征分布和非信息替代变量.
主要方法:
- * 提出了一种半监督的,高效的Q学习方法,以及两倍强大的政策外价值估计.
- * 开发了一个修改后的SSL框架,以处理预测结果的替代品,而不是政策信息.
- * 提供了Q函数和值函数估计器的理论分析,以量化SSL效率的提高.
主要成果:
- * 拟议的SSL方法与纯监督方法相比,至少具有相当的效率.
- * 该方法对由错误指定的归算模型产生的潜在偏差具有稳定性.
- * 理论结果量化了通过SSL将未标记的数据纳入实现的效率增长.
结论:
- *SSL提供了一种有效的策略,用于使用有限的标记临床数据来增强动态治疗方案的RL.
- * 拟议的方法在具有挑战性的医疗保健数据场景中提供了高效和可靠的价值估计.
- * 这项工作通过改进数据利用来推进机器学习在个性化医学中的应用.
相关概念视频
Reinforcement
917
Positive and negative reinforcement are key concepts in operant conditioning, a learning process where the consequences of a behavior affect the likelihood of that behavior being repeated.
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
Positive reinforcement occurs when a behavior is followed by the presentation of a rewarding stimulus, increasing the frequency of that behavior. For example:
917
Corrosion of Reinforcement
576
The corrosion of steel reinforcement within concrete is a process influenced by the material's inherent properties and external factors. The high pH level of around 13, provided by calcium hydroxide present in concrete, initially protects the steel reinforcement by promoting the formation of a passive iron oxide layer on its surface.
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
However, over time and under certain conditions like carbonation, chloride ingress, and cracking this protective state can be compromised. Steel has areas with...
576
Reinforcement Schedules
497
Positive reinforcement is a powerful method for teaching new behaviors to both animals and humans. B.F. Skinner demonstrated this with his experiments using rats in a Skinner box. When a rat pressed a lever, it received a food pellet. This immediate reward encouraged the rat to repeat the behavior. This method, where a reward follows every instance of the behavior, is known as continuous reinforcement. It is highly effective for establishing new behaviors quickly.
Once a behavior is learned,...
Once a behavior is learned,...
497
Reinforcements in Concrete
466
Reinforced concrete is a composite material used extensively in construction, combining the compressive strength of concrete with the tensile strength of steel. This synergy is essential as concrete, while excellent at resisting compression, is weak under tension. Steel bars, or rebars, are embedded in the concrete to handle these tensile forces. The choice of steel is strategic; it shares a similar coefficient of thermal expansion with concrete, which ensures uniformity in response to...
466
What are Estimates?
8.8K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates.
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
8.8K
Fiber Reinforced Concrete
390
Fiber-reinforced concrete significantly enhances the structural and nonstructural properties of traditional concrete by incorporating fibers like steel, glass, and polymers. These fibers, varying from natural ones such as sisal and cellulose to manufactured ones like polypropylene and Kevlar, are mixed into hydraulic cement with aggregates. Steel fibers, often preferred for their robustness, contribute to improved ductility, toughness, and post-cracking performance. The concrete is classified...
390


