Related Experiment Video
Updated: Aug 10, 2026

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
Published on: January 11, 2020
Robust Distance Correlation for Variable Screening
Tianzhou Ma1, Fan Yang2, Hongjie Ke1
1Department of Epidemiology and Biostatistics, University of Maryland, College Park, Maryland, USA.
Abstract:
In modern statistical applications, identifying critical features in high-dimensional data is essential for scientific discoveries. Traditional best subset selection methods face computational challenges, while regularization approaches such as Lasso, SCAD and their variants often exhibit poor performance with ultrahigh-dimensional data. Sure screening methods, widely used for dimensionality reduction, have been developed as popular alternatives, but few target heavy-tailed characteristics in modern big data. This paper introduces a new sure screening method, based on robust distance correlation ('RDC'), designed for heavy-tailed data. The proposed method inherits the benefits of the original model-free distance correlation-based screening while robustly estimating distance correlation in the presence of heavy-tailed data. We further develop an FDR control procedure by incorporating the Reflection via Data Splitting (REDS) method. Extensive simulations demonstrate the method's advantage over existing screening procedures under different scenarios of heavy-tailedness. Its application to high-dimensional heavy-tailed RNA-seq data from The Cancer Genome Atlas (TCGA) pancreatic cancer cohort showcases superior performance in identifying biologically meaningful genes predictive of MAPK1 protein expression critical to pancreatic cancer.
Related Concept Videos
Coefficient of Correlation
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the strength of the linear...
Correlation and Regression
Calculating and Interpreting the Linear Correlation Coefficient
Quantifying and Rejecting Outliers: The Grubbs Test
Correlation
Two variables, for example, a and b, are said to be positively correlated if both variables move in the same direction. In other words, a positive correlation exists between two variables, a and b, if:
Correlations
