在初级医疗保健数据中识别和处理数据偏差,使用合成数据生成器
Barbara Draghi1,2, Zhenchen Wang1, Puja Myles1
1Medicines and Healthcare products Regulatory Agency, London, UK.
Heliyon
|January 30, 2024
概括
先进的合成数据生成器可以创建现实的医疗数据,同时保护隐私. 本研究介绍了检测和纠正合成数据偏差的方法,改善AI模型性能,以获得更好的医疗保健结果.
科学领域:
- 医疗信息学 医疗信息学
- 人工智能的人工智能
- 数据科学数据科学数据科学
背景情况:
- 先进的合成数据生成器可以模拟敏感的患者数据,降低识别风险,并使医学AI发展成为可能.
- 像英国-NHS记录这样的大规模数据集是可用的,但来自代表性不足的队列的偏见可以转移到合成数据中.
- 机器学习模型可以延续数据偏差,导致合成数据集中的相关性和分布不准确.
研究的目的:
- 通过解决偏差和提高预测模型性能来增强合成数据生成器.
- 引入概率方法来检测和提升难以预测的样本在地面真相数据.
- 开发用于生成偏差减少合成数据的策略,这也提高了AI模型的准确性.
主要方法:
- 概率方法用于在基础真相数据集中识别具有挑战性的数据样本.
- 在合成数据生成过程中"提升"这些困难样本的技术.
- 探索预测模型的偏差降低策略与性能提升相结合.
主要成果:
- 改进了在原始数据集中的代表性不足或复杂数据点的检测.
- 增强合成数据生成,减轻偏差传播.
- 合成数据的潜力被证明可以提高人工智能诊断和管理工具的准确性和公平性.
结论:
- 概率方法可以有效地识别和解决合成数据生成中的偏差.
- 提出的技术提高了医疗AI应用的合成数据的质量.
- 这种方法有助于开发更强大的,公平的,准确的AI驱动的医疗保健解决方案.
更多相关视频
07:31Implementation of a Real-Time Psychosis Risk Detection and Alerting System Based on Electronic Health Records using CogStack
Published on: May 15, 2020
7.1K
09:33Visualizing Field Data Collection Procedures of Exposure and Biomarker Assessments for the Household Air Pollution Intervention Network Trial in India
Published on: December 23, 2022
2.2K
相关概念视频
Bias in Epidemiological Studies
271
Biases can arise at various stages of research, from study design and data collection to analysis and interpretation. Recognizing and addressing these biases is essential to ensure the validity and reliability of epidemiological findings.Broadly speaking, biases in epidemiology fall into three main categories: selection bias, information bias, and confounding. A more detailed description of possible biases is:
271
Bias
4.2K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.2K
Data Collection I
6.2K
Data collection gathers information needed to make accurate judgments about a patient's present condition. During a health history interview, subjective data is collected from the patient, their caregivers, or family members, and objective data is collected through observations and physical assessment. Patients are the primary source of subjective data. Thus information gathered from patients through interviews, observations, and physical examination is primary data. Secondary sources of...
6.2K
Data Validation
5.0K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
5.0K
Primary Healthcare Services
1.4K
Primary care promotes wellness and prevents disease. This care includes health promotion, education, protection (such as immunizations), early disease screening, and environmental considerations. Settings providing this type of healthcare include physician offices, public health clinics, school nursing, and community health nursing.
In 1978, international leaders convened in Alma-Ata, Kazakhstan, for what would be a pivotal event in global health. The Alma-Ata Declaration was the first to call...
In 1978, international leaders convened in Alma-Ata, Kazakhstan, for what would be a pivotal event in global health. The Alma-Ata Declaration was the first to call...
1.4K
Strategies for Assessing and Addressing Confounding
101
Confounding is a critical issue in epidemiological studies, often leading to misleading conclusions about associations between exposures and outcomes. It occurs when the relationship between the exposure and the outcome is mixed with the effects of other factors that influence the outcome. Given that, addressing confounding is of high importance for drawing accurate inferences in research.
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
101
