DREAMER:一个计算框架,用于评估数据集对机器学习的准备程度
Meysam Ahangaran1, Hanzhi Zhu1, Ruihui Li1
1Department of Medicine, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA.
BMC medical informatics and decision making
|June 3, 2024
概括
一个新的框架DREAMER自动评估和改进机器学习 (ML) 的表式数据集质量. 这提高了ML模型的准确性,通过完善数据准备用于研究和开发.
科学领域:
- 计算机科学 计算机科学
- 数据科学数据科学数据科学
- 人工智能的人工智能
背景情况:
- 机器学习 (ML) 对于大规模数据分析至关重要.
- 数据集的质量对于成功部署ML模型至关重要.
- 评估数据准备状态的现有方法可能是手动的,耗时的.
研究的目的:
- 引入DREAMER (用于机器学习研究的数据准备),这是一个自动化框架,用于评估表格式数据集对ML的适用性.
- 为研究界提供一个开源工具,以提高数据质量.
主要方法:
- 开发了DREAMER,一个使用监督和无监督ML技术的算法框架.
- 将框架应用于三个不同的表格数据集.
- 使用已建立的数据质量指标进行评估.
主要成果:
- DREAMER显著提高了数据集质量,提高了对ML任务的准备.
- 有效地消除了外部特征和行,简化了数据集.
- 数据精制过程导致监督和无监督学习的准确性提高.
结论:
- 梦想提供了数据准备的自动化解决方案,提高了ML管道的原始数据集完整性.
- 该框架简化了数据集,提高了ML算法的准确性和效率.
- 在GitHub和Docker上的开放可访问性促进了社区的采用和进一步发展.
更多相关视频
08:42The DREAM Implant: A Lightweight, Modular, and Cost-Effective Implant System for Chronic Electrophysiology in Head-Fixed and Freely Behaving Mice
Published on: July 26, 2024
1.0K
08:05Measuring Statistical Learning Across Modalities and Domains in School-Aged Children Via an Online Platform and Neuroimaging Techniques
Published on: June 30, 2020
7.5K
相关概念视频
Dreaming
146
Sigmund Freud revolutionized our understanding of dreams by proposing that they are a window into the unconscious mind. According to Freud, dreams are not mere stories our minds create while we sleep but are profoundly meaningful narratives about our hidden desires and fears. He introduced two key concepts: manifest content and latent content. The manifest content is the actual content and imagery of the dream — what we remember when we wake up. The latent content, however, represents the...
146
Lucid Dreaming
131
Lucid dreaming is a unique state of consciousness where an individual realizes they are dreaming while still in the dream. This awareness allows them to manipulate their dream environment consciously. Researchers like Stephen LaBerge have significantly contributed to the understanding of lucid dreams, highlighting that during these dreams, certain areas of the brain, such as the prefrontal cortex, that involve self-awareness and thought evaluation show increased activity.
Studies have shown...
Studies have shown...
131
