叶:通过事实检查增强学习和评估,以提高大型语言模型中的事实性
Hieu Tran1,2, Junda Wang1,2, Yujan Ting1
1United Imaging Intelligence, Boston, MA, USA.
概括
大型语言模型 (LLM) 现在可以使用LEAF框架进行医学准确性的事实检查. 该系统通过整合强大的事实检查和指导检索来改善医疗保健中的LLM响应,提高可靠性.
科学领域:
- 人工智能的人工智能
- 医疗信息学 医疗信息学
- 自然语言处理自然语言处理.
背景情况:
- 大型语言模型 (LLM) 在事实准确性方面存在局限性,特别是在诸如医疗保健等知识密集型领域.
- 确保事实正确性对于可靠的医疗问题答案系统至关重要.
研究的目的:
- 引入LEAF (通过事实核查增强的学习和评估),这是一个旨在提高医学问题答案LLMs事实性的新框架.
- 为应对在专业领域的法学士事实不准确性的挑战.
主要方法:
- LEAF集成了三个核心组件:RAFE (强大的精确事实检查引擎) 用于响应评估,事实检查-然后-RAG用于检索指导,以及从事实检查中学习进行自我训练.
- RAFE使用开源的LLM和特定域的检索来进行准确性评估.
- 事实检查-然后-RAG使用事实检查结果来完善检索流程,而不会改变模型参数.
主要成果:
- 与事实检查-GPT等现有方法相比,RAFE在识别不准确性方面表现优异.
- 事实检查然后RAG方法有效地纠正了响应错误.
- 从事实检查学习组件通过自我训练提高了LLM的表现,即使不需要标记数据.
结论:
- 叶子显著提高了医学问题的答案LLM事实性,为工业应用要求高精度提供可扩展的解决方案.
- 在医疗保健领域的现实世界部署表明,事实性得分有83%的改善,验证了LEAF在适应LLM到特定组织知识库方面的实际应用性.
相关概念视频
Language
919
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
919
Components of Language
825
Language, whether spoken, signed, or written, consists of specific components: lexicon and grammar. The lexicon is the vocabulary of a language, comprising its words. Grammar is the set of rules used to convey meaning through the lexicon. For example, English grammar adds “-ed” to most verbs to indicate past tense. Words are formed by combining phonemes, which are the basic sound units of a language. Different languages have different sets of phonemes (e.g., “ah” vs.
825
Language Development
925
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
925
Language and Cognition
806
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
806
Protein Folding Quality Check in the RER
5.3K
ER is the primary site for the maturation and folding of soluble and transmembrane secretory proteins. The calnexin cycle is a specific chaperone system that folds and assesses the confirmation of N-glycosylated proteins before they can exit the ER lumen. The primary players of this quality check pipeline are the lectins, ER-resident chaperones, and a glucosyl transferase enzyme. In case the calnexin system in the lumen fails to salvage a misfolded protein, it is transported to the cytoplasm...
5.3K
Self-Evaluation Maintenance Model
329
The Self-Evaluation Maintenance (SEM) model offers a psychological framework to understand how individuals’ self-esteem is influenced by the achievements of others, particularly those with whom they share close personal bonds. The SEM model operates when personal rather than social identity guides individuals. Central to this model is the notion that individuals have an inherent desire to preserve a favorable self-image, which is continuously shaped by interpersonal comparisons and...
329


