模拟测试对环境数字书记者的评估的价值:一个案例报告
Joshua M Biro1, Jessica L Handley1, James Mickler2
1MedStar Health National Center for Human Factors in Healthcare, Washington, DC 20008, United States.
概括
模拟测试可以有效地识别人工智能 (AI) 产品中的安全问题. 这一关键的第一步有助于在临床实施之前评估支持人工智能的技术.
科学领域:
- 医疗信息学 医疗信息学
- 医疗保健中的人工智能
- 临床模拟 临床模拟
背景情况:
- 支持人工智能 (AI) 的产品,如Ambient Digital Scribe (ADS),正在迅速发展并集成到临床实践中.
- 人工智能发展的速度往往超过了彻底的安全评估.
- 对人工智能工具的客观评估对于确保患者安全和有效性至关重要.
研究的目的:
- 展示模拟测试对人工智能产品快速评估的价值.
- 为了比较两个不同的环境数字写字器 (ADS) 产品的性能和安全性.
主要方法:
- 研究人员和医生模拟了两种ADS产品在编程的门诊接触期间的使用.
- 总共使用AI工具生成了44个临床笔记草案.
- 分析的重点是编辑的时间,感知到的努力,以及人工智能生成的笔记中的错误 (遗漏,添加,无关/错位文本).
主要成果:
- 与ADS产品B相比,ADS产品A需要更长的编辑时间,而ADS产品B需要更长的编辑时间.
- 在ADS产品A中,遗漏较少,但添加和无关/错位的文本错误较多.
- 尽管编辑时间有差异,但ADS产品A在大多数模拟遭遇中被评为表现更好.
结论:
- 模拟测试提供了一种有效的方法来识别人工智能支持的医疗保健技术中的潜在安全问题.
- 这种方法是人工智能工具评估过程中至关重要的第一步.
- 优先考虑模拟测试可以帮助减轻与临床环境中快速实施AI相关的风险.
更多相关视频
07:15Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research
Published on: December 18, 2020
4.4K
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
649
相关概念视频
02:46Uncertainty in Measurement: Reading Instruments
37.7K
Counting is the type of measurement that is free from uncertainty, provided the number of objects being counted does not change during the process. Such measurements result in exact numbers. By counting the eggs in a carton, for instance, one can determine exactly how many eggs are there in the carton. Similarly, the numbers of defined quantities are also exact. For example, 1 foot is exactly 12 inches, 1 inch is exactly 2.54 centimeters, and 1 gram is exactly 0.001 kilograms. Quantities...
37.7K
01:22Self-Report Tests of Personality
1.3K
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
1.3K