从点到概率梯度提升,用于索赔频率和严重性预测
Dominik Chevalier1, Marie-Pier Côté1
1École d'actuariat, Université Laval, 2425, rue de l'Agriculture, Québec, Qc G1V 0A6 Canada.
概括
渐变增强决策树算法提供了卓越的精算预测. 这项研究统一和比较了11个算法,发现LightGBM和XGBoostLSS在效率方面表现出色,而CatBoost和EGBM显示出强大的预测性能.
科学领域:
- 精算科学 精算科学
- 机器学习 机器学习
- 数据科学数据科学数据科学
背景情况:
- 渐变增强决策树算法在精算应用中越来越受欢迎,因为它们的预测性能优于传统的通用线性模型.
- 已经开发了大量对初始梯度增强机器算法的改进.
研究的目的:
- 为决策树算法提供统一的符号和对比现有的点和概率梯度提升.
- 在精算数据集上对这些算法进行全面的数值比较.
主要方法:
- 这是一项对11个梯度增强算法的比较数值研究:GBM,XGBoost,DART,LightGBM,CatBoost,EGBM,PGBM,XGBoostLSS,循环GBM和NGBoost.
- 评估了五个公共数据集的索赔频率和严重程度,考虑了变量大小和高卡丁级分类变量.
- 分析计算效率,预测性能和模型充分性,包括处理频率模型中的不同风险暴露.
主要成果:
- 轻GBM和XGBoostLSS展示了卓越的计算效率.
- CatBoost 显示出更好的预测性能,特别是在高卡丁度的分类变量中.
- 可解释的 EGBM 实现了与黑盒模型相比具有竞争力的预测性能.
结论:
- 在梯度增强算法中,模型充分性和预测准确性之间没有权衡;两者可以同时实现.
- 算法选择对计算效率和预测性能产生影响,特别是在精算建模中的分类变量处理方面.
相关概念视频
Testing a Claim about Standard Deviation
2.9K
A complete procedure to test a claim about population standard deviation or population variance is explained here.
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...
2.9K
Testing a Claim about Population Proportion
3.9K
A complete procedure for testing a claim about a population proportion is provided here.
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
There are two methods of testing a claim about a population proportion: (1) Using the sample proportion from the data where a binomial distribution is approximated to the normal distribution and (2) Using the binomial probabilities calculated from the data.
The first method uses normal distribution as an approximation to the binomial distribution. The requirements are as follows: sample size is large...
3.9K
Prediction Intervals
3.2K
The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
3.2K
Testing a Claim about Mean: Known Population SD
3.2K
A complete procedure of testing the hypothesis about a population mean is explained here.
Estimating a population mean requires the samples to be distributed normally. The data should be collected from the randomly selected samples having no sampling bias. The sample size needed to be higher than 30, and most importantly, the population standard deviation should be already known.
In most realistic situations, the population standard deviation is often unknown, but in rare circumstances, when it...
Estimating a population mean requires the samples to be distributed normally. The data should be collected from the randomly selected samples having no sampling bias. The sample size needed to be higher than 30, and most importantly, the population standard deviation should be already known.
In most realistic situations, the population standard deviation is often unknown, but in rare circumstances, when it...
3.2K
Expected Frequencies in Goodness-of-Fit Tests
7.1K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
7.1K
Testing a Claim about Mean: Unknown Population SD
5.5K
A complete procedure of testing a hypothesis about a population mean when the population standard deviation is unknown is explained here.
Estimating a population mean requires the samples to be approximately normally distributed. The data should be collected from the randomly selected samples having no sampling bias. There is no specific requirement for sample size. But if the sample size is less than 30, and we don't know the population standard deviation, a different approach is used;...
Estimating a population mean requires the samples to be approximately normally distributed. The data should be collected from the randomly selected samples having no sampling bias. There is no specific requirement for sample size. But if the sample size is less than 30, and we don't know the population standard deviation, a different approach is used;...
5.5K

