Related Experiment Video
Updated: May 3, 2026

05:37
An R-Based Landscape Validation of a Competing Risk Model
Published on: September 16, 2022
2.3K
Risk factor selection in rate making: EM adaptive LASSO for zero-inflated poisson regression models
Yanlin Tang1, Liya Xiang, Zhongyi Zhu
1Department of Mathematics, Tongji University, Shanghai, 200092, China.
Summary
This study introduces EM adaptive LASSO, a new method for selecting risk factors in insurance. It effectively identifies important factors and removes irrelevant ones from zero-inflated claim frequency data.
Area of Science:
- Statistics
- Actuarial Science
- Data Science
Background:
- Risk factor selection is crucial for accurate insurance rate-making and understanding policyholder characteristics.
- Zero-inflated data, common in insurance claim frequency, pose significant challenges for traditional risk factor selection methods.
- Existing methods struggle to effectively handle the complexities introduced by excess zeros in insurance datasets.
Purpose of the Study:
- To propose a novel risk factor selection approach tailored for zero-inflated Poisson regression models.
- To address the difficulties in identifying significant risk factors within insurance data characterized by a high prevalence of zero claims.
- To enhance the precision of rate-making and the identification of high-value insureds through improved factor selection.
Main Methods:
- Development of the EM adaptive LASSO (Least Absolute Shrinkage and Selection Operator) method.
- Integration of the Expectation-Maximization (EM) algorithm with an adaptive LASSO penalty.
- Theoretical analysis demonstrating the selection consistency of the proposed method under regularity conditions.
Main Results:
- The EM adaptive LASSO method successfully selects important risk factors while excluding redundant ones with high probability.
- Simulation studies confirm the finite sample performance and effectiveness of the proposed approach.
- Application to car insurance data from the SAS Enterprise Miner database validates the method's practical utility.
Conclusions:
- The proposed EM adaptive LASSO offers a robust and effective solution for risk factor selection in zero-inflated insurance data.
- This method improves the accuracy of statistical modeling in insurance, leading to better risk assessment and pricing.
- The findings provide a valuable tool for actuaries and data scientists in the insurance industry for enhanced data analysis.
Related Concept Videos
Parametric Survival Analysis: Weibull and Exponential Methods
1.3K
Parametric survival analysis models survival data by assuming a specific probability distribution for the time until an event occurs. The Weibull and exponential distributions are two of the most commonly used methods in this context, due to their versatility and relatively straightforward application.
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
Weibull Distribution
The Weibull distribution is a flexible model used in parametric survival analysis. It can handle both increasing and decreasing hazard rates, depending on its shape parameter...
1.3K
Truncation in Survival Analysis
707
Truncation in survival analysis refers to the exclusion of individuals or events from the dataset based on specific criteria related to the time of the event. This exclusion can happen in two primary forms: left truncation and right truncation.
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
Left truncation occurs when individuals who experienced the event of interest before a certain time are not included in the study. This is often due to a "delayed entry" into the study where only those who survive until a certain entry point are...
707
Hazard Rate
525
The hazard rate, also known as the hazard function or failure rate, is a statistical measure used to describe the instantaneous rate at which an event occurs, given that the event has not yet happened. From a probabilistic perspective, it represents the likelihood that a subject will experience the event in a very small time interval, conditional on surviving up to the beginning of that interval. In terms of frequency, the hazard rate can be viewed as the ratio of the number of events to the...
525
Assumptions of Survival Analysis
492
Survival models analyze the time until one or more events occur, such as death in biological organisms or failure in mechanical systems. These models are widely used across fields like medicine, biology, engineering, and public health to study time-to-event phenomena. To ensure accurate results, survival analysis relies on key assumptions and careful study design.
492
The Mantel-Cox Log-Rank Test
1.2K
The Mantel-Cox log-rank test is a widely used statistical method for comparing the survival distributions of two groups. It tests whether a statistically significant difference exists in survival times between the groups without assuming a specific distribution for the survival data, making it a non-parametric test. This flexibility makes the log-rank test particularly valuable in medical research and other fields where the timing of an event, such as death or disease recurrence, is of...
1.2K
Censoring Survival Data
689
Survival analysis is a statistical method used to analyze time-to-event data, often employed in fields such as medicine, engineering, and social sciences. One of the key challenges in survival analysis is dealing with incomplete data, a phenomenon known as "censoring." Censoring occurs when the event of interest (such as death, relapse, or system failure) has not occurred for some individuals by the end of the study period or is otherwise unobservable, and it might have many different...
689

