在文本复杂性建模的情况下,模型可解释性增强了域泛化
Frans van der Sluis1, Egon L van den Broek2
1Department of Communication, University of Copenhagen, Copenhagen, Denmark.
Patterns (New York, N.Y.)
|March 5, 2025
概括
与不透明模型相比,可解释的机器学习模型显示出优越的域泛化,特别是当与有针对性的分布外数据进行验证时. 这种方法提高了对数据转移的稳定性.
科学领域:
- 机器学习 机器学习
- 自然语言处理自然语言处理.
- 认知科学 认知科学
背景情况:
- 在机器学习中,平衡预测准确性,模型解释性和域泛化是机器学习的一个关键挑战.
- 在不同的数据分布中评估模型性能 (分布外测试) 对现实世界的适用性至关重要.
研究的目的:
- 调查模型可解释性和域泛化之间的权衡.
- 评估可解释与不透明模型在涉及文本复杂性和读者处理困难的任务中的性能.
- 确定提高模型稳定性和概括性的策略.
主要方法:
- 调整了77,640个配置,选择了120个可解释和166个不透明的模型.
- 包括像ChatGPT这样的大型语言模型和概率模型.
- 采用了两项任务的方法:对文本复杂性的文本分类和一般化来预测处理难度.
主要成果:
- 在最初的文本分类任务中确认了准确性-解释性权衡.
- 证明可解释模型在域泛化 (任务2) 中显著优于不透明模型.
- 发现乘法相互作用进一步改善了可解释模型的域概括.
结论:
- 倡导在培训中使用大数据,并增加可解释性的外部理论.
- 强调小型,精心设计的分布外数据集对于验证模型概括性和稳定性的重要性.
- 强调可解释的模型是实现可靠领域概括的关键.
相关概念视频
Modeling and Similitude
213
Scaled modeling is a fundamental technique in engineering, enabling the study of large and complex systems by creating smaller, manageable replicas that recreate critical characteristics of the original. In hydrology and civil infrastructure, for example, scaled models of dams help analyze water flow, turbulence, and pressure. This method allows for accurate predictions of real-world behavior within a controlled environment, significantly reducing the cost and time involved in full-scale...
213
Multicompartment Models: Overview
79
Multicompartment models are mathematical constructs that depict how drugs are distributed and eliminated within the body. They segment the body into several compartments, symbolizing various physiological or anatomical areas connected through drug transfer processes such as absorption, metabolism, distribution, and elimination.
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
These models offer a more comprehensive representation of drug behavior in the body than one-compartment models. They accommodate the complexity of drug distribution,...
79
Survival Tree
50
Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
Building a Survival Tree
Constructing a...
Building a Survival Tree
Constructing a...
50
Mechanistic Models: Compartment Models in Individual and Population Analysis
23
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
23
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
38
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
38
Improving Translational Accuracy
2.5K
2.5K


