电子健康记录中的标签准确性及其对早期预测妊娠糖尿病的机器学习模型的影响:三步追溯验证研究
Mark Germaine1,2, Amy C O'Higgins3, Brendan Egan2
1School of Computing, Dublin City University, Glasnevin, Dublin, D09 V209, Ireland, 353 1 700 8803.
JMIR medical informatics
|August 25, 2025
概括
在电子健康记录 (EHR) 中准确验证妊娠糖尿病 (GDM) 标签至关重要. 虽然EHR数据对机器学习模型训练的影响很小,但测试集的准确性显著影响性能评估,强调了数据验证的必要性.
科学领域:
- 医疗信息学
- 在医疗保健中的机器学习
- 生殖健康
背景情况:
- 电子健康记录 (EHR) 越来越多地用于机器学习 (ML) 模型来预测妊娠糖尿病 (GDM).
- 之前的研究没有证实GDM标签在电子健康记录中的准确性.
- 这项研究解决了在电子健康记录中评估GDM诊断准确性的关键问题.
研究的目的:
- 检查电子健康记录 (EHR) 中记录的妊娠糖尿病 (GDM) 诊断的准确性.
- 将EHRGDM诊断与可信的临床团队数据库 (CTD) 进行比较.
- 评估EHR数据准确性对预测GDM的机器学习模型的性能的影响.
主要方法:
- 从2018-2022年对临床团队数据库 (CTD) 进行EHR数据的验证,以确定真假阳性/阴性.
- 使用原始电子病历标签和验证的标签进行训练和测试后勤回归模型.
- 模拟标签噪声以评估其对模型性能指标的影响,如ROC AUC和平均精度 (AP).
主要成果:
- 在3952名患者中,有85. 7%的患者在EHR和CTD之间有一致的GDM识别.
- 通过验证的标签进行训练和测试的模型获得了0.817的ROC AUC和0.450的AP.
- 试验组中的噪声,特别是假阳性,显著降低了模型性能.
结论:
- 电子健康记录和CTD之间的GDM诊断差异对模型培训的影响很小.
- 精确的数据验证是必不可少的,因为试验组中的电子健康记录标签的不准确性会对性能评估产生重大影响.
- 强调数据质量和验证在开发可靠的GDM预测模型中的关键作用.
相关概念视频
Diabetes Mellitus: Type 2 and Gestational
2.9K
Type 2 diabetes, characterized by insulin resistance, arises when the insulin receptors on cells lose responsiveness to insulin, diminishing the cell's capacity to take up glucose, resulting in elevated blood glucose levels. To receive a diagnosis of Type 2 diabetes, a series of blood glucose tests are necessary to assess whether the blood glucose falls within normal parameters. If the result is out of the normal range, a patient may be diagnosed as prediabetic or diabetic, depending on the...
2.9K
Errors occurring during blood pressure monitoring
965
Blood pressure monitoring is a crucial clinical procedure in diagnosing and managing various cardiovascular conditions. Despite its significance, the accuracy of blood pressure measurements can be compromised by multiple factors, potentially leading to either falsely high or low readings. These inaccuracies are critical as they can significantly impact patient care. So, it is vital to understand these challenges deeply and adopt strategic approaches to minimize errors.
Several factors...
Several factors...
965
Pathophysiology of Diabetes
1.2K
Diabetes mellitus is a chronic metabolic disorder characterized by hyperglycemia. The four categories of diabetes are type 1 diabetes, type 2 diabetes, other specific types of diabetes, and gestational diabetes.
Type 1 diabetes is characterized by autoimmune-mediated destruction of pancreatic β cells, with environmental factors potentially triggering this process in genetically susceptible individuals. Despite many not having a family history, certain genes increase susceptibility,...
Type 1 diabetes is characterized by autoimmune-mediated destruction of pancreatic β cells, with environmental factors potentially triggering this process in genetically susceptible individuals. Despite many not having a family history, certain genes increase susceptibility,...
1.2K
Documentation of Nursing Diagnosis
1.3K
The nurse documents nursing diagnoses and enters them into the patient record. The identified patient's nursing diagnosis is either written out with a plan of care or entered into the electronic health record.
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters...
1.3K
Regression Toward the Mean
6.5K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.5K


