在专业领域对实体规范化评估偏见的分析
Arnaud Ferré1, Philippe Langlais2
1MaIAGE, INRAE, Université Paris-Saclay, Jouy-en-Josas, France. arnaud.ferre@inrae.fr.
BMC bioinformatics
|June 2, 2023
概括
实体规范化方法看起来有希望,但面临评估偏差. 改进的评估实践对于推动临床和生物医学信息提取研究至关重要.
科学领域:
- 生物医学信息学 生物医学信息学
- 计算语言学 计算语言学
- 提取信息 提取信息
背景情况:
- 实体规范化是信息提取的关键任务,特别是在临床和生命科学领域.
- 当前最先进的方法在受欢迎的基准指标上取得了良好的表现.
- 尽管取得了进展,但在完全解决实体正常化任务方面仍然存在重大挑战和局限性.
研究的目的:
- 在实体规范化任务中调查潜在的评估偏差.
- 突出实体规范化方法评估中存在的问题.
- 为更强大的评估实践提出改进建议.
主要方法:
- 选择两个黄金标准的机构进行分析.
- 使用两种最先进的实体规范化方法.
- 经验分析以识别和证明评估偏见.
主要成果:
- 初步发现表明实体规范化中存在评估问题.
- 通过对选定的体和方法的分析,确定了特定的偏见.
- 该研究提供了证据,证明当前评估策略存在缺陷.
结论:
- 目前对实体规范化的评估实践是不够的.
- 提出了加强评估方法的建议.
- 改进的评估对于实体规范化研究的进展至关重要.
更多相关视频
07:26Executing Complexity-Increasing Queries in Relational MySQL and NoSQL MongoDB and EXist Size-Growing ISO/EN 13606 Standardized EHR Databases
Published on: March 19, 2018
9.4K
05:47Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
348
相关概念视频
Confirmation Biases
5.5K
The confirmation bias is the tendency to focus on information that confirms our existing beliefs and ignore information that is inconsistent with our expectations. For example, if you think that your professor is not very nice, you notice all of the instances of rude behavior exhibited by the professor while ignoring the countless pleasant interactions he is involved in on a daily basis. Have you ever fallen prey to the confirmation bias, either as the source or target of such bias?
5.5K
Bias
4.3K
Bias refers to any tendency that prevents a question from being considered unprejudiced. In research, bias occurs when one outcome or answer is selected or encouraged over others in sampling or testing. Bias can occur during any research phase, including study design, data collection, analysis, and publication.
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
4.3K
Normal and Tangetial Components: Problem Solving
208
Consider a man with a mass of 70 kg seated in a chair connected to a pin support through a member BC. If the man maintains an upright position, the task is to determine the horizontal and vertical reactions of the chair on the man when the member makes a 45° angle with the horizontal. At this moment, the man has a speed of 5 m/s, increasing at a rate of 1 m/s².
208
Stereotype Content Model
14.8K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
14.8K
Generalization, Discrimination, and Extinction
668
Generalization, discrimination, and extinction are key concepts in operant conditioning that influence how behaviors are learned and maintained.
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
Generalization occurs when a behavior reinforced in one context is performed in similar situations. For instance, a student who studies diligently for calculus and receives excellent grades might apply the same study habits to psychology and history, expecting similar results. Generalization shows how learning in one setting can influence behavior in...
668
Types of Errors: Detection and Minimization
1.7K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
1.7K
