无监督变量选择的变量优先级
Lili Zhou1, Min Lu1, Hemant Ishwaran1
1Division of Biostatistics, Miller School of Medicine, University of Miami.
概括
本研究引入了一种新的无监督特征选择方法,通过调整监督变量优先级 (VarPro). 该方法使用局部分类和拉索回归来提高高维数据的性能.
科学领域:
- 机器学习 机器学习
- 生物信息学是一种生物信息学.
- 数据科学数据科学数据科学
背景情况:
- 当标记数据不可用时,无监督的功能选择至关重要.
- 现有的方法有局限性,需要新的方法.
- 高维数据在识别信息特征方面存在挑战.
研究的目的:
- 将监督变量优先级 (VarPro) 框架扩展到不受监督的设置.
- 开发一种有效的特征选择方法,而不需要标记数据.
- 在高维和复杂的数据场景中提高性能.
主要方法:
- 重构特征选择作为局部化的两类分类问题.
- 使用决策树规则和区域成员身份定义隐含的类标签.
- 整合基于拉索的回归以减少稀疏性和噪音.
主要成果:
- 对合成数据的现有无监督特征选择方法进行了持续的改进.
- 在现实世界的生物和图像数据集上验证的有效性.
- 成功地恢复了已知的癌症相关基因,并改善了肺癌亚型.
结论:
- 拟议的方法为无监督的特征选择提供了一个强大的解决方案.
- 来自决策树的隐性监督可以增强特征识别.
- 这种方法对生物信息学和数据分析的应用非常有希望.
相关概念视频
Multi-input and Multi-variable systems
383
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence of...
In the absence of...
383
Variability: Analysis
433
Measures of variability are statistical metrics that reveal the dispersion pattern within a dataset. They are pivotal in biostatistics, providing insights into the heterogeneity within health and biological data. Variability signifies the degree to which data points diverge from one another, helping researchers understand the potential range of values and associated uncertainty within the data.
The range is a simple measure of variability, indicating the difference between the highest and...
The range is a simple measure of variability, indicating the difference between the highest and...
433
Randomized Experiments
8.8K
The randomization process involves assigning study participants randomly to experimental or control groups based on their probability of being equally assigned. Randomization is meant to eliminate selection bias and balance known and unknown confounding factors so that the control group is similar to the treatment group as much as possible. A computer program and a random number generator can be used to assign participants to groups in a way that minimizes bias.
Simple randomization
Simple...
Simple randomization
Simple...
8.8K
Quantifying and Rejecting Outliers: The Grubbs Test
3.5K
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.5K
Random Variables
17.3K
A random variable is a single numerical value that indicates the outcome of a procedure. The concept of random variables is fundamental to the probability theory and was introduced by a Russian mathematician, Pafnuty Chebyshev, in the mid-nineteenth century.
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
Uppercase letters such as X or Y denote a random variable. Lowercase letters like x or y denote the value of a random variable. If X is a random variable, then X is written in words, and x is given as a number.
For example, let X = the...
17.3K
Decision Making: P-value Method
6.8K
The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim is also stated. These statements can act as null and alternative hypotheses: a null hypothesis would be a neutral statement while the alternative hypothesis can...
6.8K


