医疗教育中安全有效的大型语言模型的成本,可用性,可信度,公平性,问责制,透明度和可解释性框架:叙述审查和定性研究
Majdi Quttainah1, Vinaytosh Mishra2, Somayya Madakam3
1College of Business Administration, Kuwait University, Kuwait, Kuwait.
JMIR AI
|June 14, 2024
概括
信誉,问责和公平是医学教育中开发大型语言模型 (LLM) 的关键推动因素. 一个新的框架,CUC-FATE,指导对有效实施LLM的这些关键因素的评估.
科学领域:
- 医疗教育 技术 技术 医学教育
- 医疗保健中的人工智能
- 大型语言模型 (LLM)
背景情况:
- 医疗保健中LLM的日益普及为改善可访问性和效率提供了机会.
- 缺乏专门为医学教育开发LLM的指导方针.
- 需要一个结构化的方法来识别和优先考虑LLM在这个领域的发展推动者.
研究的目的:
- 确定和优先考虑在医学教育中成功开发LLM的关键推动因素.
- 分析这些已识别的推动者之间的相互关系和等级结构.
- 开发一个实用的框架来评估医学教育中的LLMs.
主要方法:
- 叙事文献审查以确定初始的LLM开发启动器.
- 分析层次流程 (AHP) 来确定用户优先考虑的启用器重要性.
- 总解释性结构建模 (TISM) 分析开发人员对启用者层次结构的看法.
- 进行MICMAC分析,以评估启动器的驾驶和依赖能力.
- 焦点小组采用非概率的有目的抽样方法.
主要成果:
- 可信度成为最关键的推动因素 (优先权重为0.37),其次是问责制 (0.276) 和公平 (0.106).
- 用户发现可用性的重要性微不足道 (0.04).
- 产品开发人员认为成本是最不重要的推动因素,尽管MICMAC分析显示其对其他因素的影响很大.
- TISM的结果通常与AHP的发现一致,证实了用户的偏好.
- 焦点小组输入可靠,一致性比为0.084.
结论:
- 这项研究提供了对医学教育的LLM启用器的首次全面分析.
- 一个规范性框架,CUC-FATE (成本,可用性,可信性,公平性,问责性,透明度,可解释性),是开发用于评估LLM启用器.
- 研究结果为医疗保健专业人员,技术专家,监管机构和参与医学教育LLM实施的决策者提供了宝贵的指导.
相关概念视频
Improving Translational Accuracy
2.6K
2.6K
Methods of Documentation VI: Case Management Model
567
The case management model is a multidisciplinary approach that involves healthcare professionals from diverse disciplines, such as physicians, nurses, therapists, social workers, and pharmacists, working collaboratively to address the various needs of patients. Each healthcare professional brings unique expertise and perspectives, contributing to a more comprehensive understanding of the patient's condition and tailoring treatment plans accordingly.
For example, a patient with a chronic...
For example, a patient with a chronic...
567
Guidelines for Nursing Documentation I
1.0K
Quality documentation and reporting share essential characteristics that ensure they are practical and valuable resources for those who use them. These characteristics are:
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
1.0K
Data Validation
5.0K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
5.0K
Health Literacy
4.0K
Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative...
4.0K
Introduction to Documentation and Reporting
2.0K
Documentation is the systematic process of formally recording, maintaining, and communicating information.
Nursing documentation records essential information and details regarding a patient's care and treatment in written or electronic form. It is a critical aspect of nursing practice that involves documenting assessments, interventions, outcomes, and other relevant details about a patient's health status.
Documentation maps the patient's health journey by creating a comprehensive...
Nursing documentation records essential information and details regarding a patient's care and treatment in written or electronic form. It is a critical aspect of nursing practice that involves documenting assessments, interventions, outcomes, and other relevant details about a patient's health status.
Documentation maps the patient's health journey by creating a comprehensive...
2.0K


