使用大型语言模型比较日本文本中识别失明的准确性
Ayako Yagahara1, Haluna Mori1, Naoki Nishimoto2
1Department of Radiological Technology, Hokkaido University of Science.
Studies in health technology and informatics
|August 8, 2025
概括
这项研究评估了用于提取个人信息的大型语言模型 (LLM). 伯特在识别名字和位置方面表现出最高的准确性,因此非常适合用于非识别工具.
科学领域:
- 自然语言处理自然语言处理.
- 数据去标识 数据去标识
- 机器学习 机器学习
背景情况:
- 准确提取个人信息对于数据隐私至关重要.
- 大型语言模型 (LLM) 显示了自动信息提取的潜力.
- 开发有效的解除身份工具对于处理敏感数据至关重要.
研究的目的:
- 评估不同LLM在提取个人,设施和地名的准确性.
- 评估使用LLM来开发内部非识别工具的可行性.
- 为了比较BERT,GPT3.5和GPT4o-mini在命名实体识别方面的性能.
主要方法:
- 三个LLM (BERT,GPT3.5,GPT4o-mini) 被用来进行信息提取.
- 一项试点研究分析了20篇日本报纸文章.
- 用F1得分测量了提取精度,用于个人名,设施名和地名.
主要成果:
- 伯特 (BERT) 获得了最高的F1总分,为0.94.
- 在提取个人名 (0.99),设施名 (0.89) 和地名 (0.93) 方面,BERT表现出卓越的性能.
- 与BERT相比,GPT3.5和GPT4o-mini的准确性较低.
结论:
- 在测试的模型中,BERT是最有效的LLM用于自动提取个人信息.
- 这些发现支持使用BERT来开发对临床数据的强大非识别工具.
- 进一步的研究可以探索BERT在各种数据集中的应用,以加强数据隐私.
更多相关视频
相关概念视频
Improving Translational Accuracy
11.9K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
11.9K
Language Development
450
Children master language quickly and with relative ease, supported by both biological predisposition and reinforcement. B. F. Skinner (1957) proposed that language is learned through reinforcement, while Noam Chomsky (1965) argued that language acquisition mechanisms are biologically determined.
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
450
Stereotype Content Model
14.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.9K
Masking and Demasking Agents
2.7K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.7K
Deindividuation
27.3K
Deindividuation is a form of social influence on an individual’s behavior such that the individual engages in unusual or non-normal behavior while in a group setting. Why? Because in these group settings, the individual no longer sees themselves as an individual anymore, disinhibiting their behavior and personal restraint.
27.3K
Language
425
Language is a unique communication system that uses words and systematic rules to organize and transmit information. Unlike other forms of communication, which may involve postures, movements, odors, or vocalizations, language relies on symbols and grammar. This makes human communication distinct from that of other species, who also communicate but do not use language in the same way humans do.
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
Corballis and Suddendorf (2007) and Tomasello and Rakoczy (2003) highlight the role of language in...
425


