Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Introduction to Test of Independence01:21

Introduction to Test of Independence

2.1K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.1K
Hypothesis Test for Test of Independence01:16

Hypothesis Test for Test of Independence

6.2K
The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test is used to examine the independence of the variables. One can construct two qualitative survey questions or experiments based on the variables in a contingency table. The goal is to see if the two variables are unrelated (independent) or related (dependent). The null and alternative hypotheses for this test are:
H0: The two variables (factors)...
6.2K
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

7.0K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
7.0K
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

580
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
580
Quantifying and Rejecting Outliers: The Grubbs Test01:02

Quantifying and Rejecting Outliers: The Grubbs Test

3.9K
Sometimes, a data set can have a recorded numerical observation that greatly  deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier.  To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...
3.9K
Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data01:16

Statistical Inference Techniques in Hypothesis Testing: Parametric Versus Nonparametric Data

671
Statistical inference techniques, paramount in hypothesis testing, differentiate into two broad categories: parametric and nonparametric statistics.
Parametric statistics, as the name suggests, assumes that data follow a specific distribution, often a normal distribution. This assumption enables robust hypothesis testing and estimation. Parametric methods, like the Student's t-test or Goodness-of-fit test, are frequently employed in biostatistics due to their robustness. For instance,...
671

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Anomalous Saturation of CO Adsorption at 26% on Cu(111) Governed by Nanometer-Scale Substrate-Mediated Interactions.

Journal of the American Chemical Society·2025
Same author

Opportunities and challenges of diffusion models for generative AI.

National science review·2024
Same author

Are Latent Factor Regression and Sparse Regression Adequate?

Journal of the American Statistical Association·2024
Same author

Understanding Implicit Regularization in Over-Parameterized Single Index Model.

Journal of the American Statistical Association·2024
Same author

Communication-Efficient Accurate Statistical Estimation.

Journal of the American Statistical Association·2023
Same author

Convex and Nonconvex Optimization Are Both Minimax-Optimal for Noisy Blind Deconvolution under Random Designs.

Journal of the American Statistical Association·2023

Related Experiment Video

Updated: Apr 22, 2026

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

15.2K

Nonparametric Independence Screening in Sparse Ultra-High Dimensional Varying Coefficient Models.

Jianqing Fan1, Yunbei Ma2, Wei Dai1

  • 1Princeton University, Princeton, New Jersey 08544 USA.

Journal of the American Statistical Association
|October 14, 2014
PubMed
Summary

This study introduces nonparametric screening methods for variable selection in complex statistical models with many predictors. The proposed methods efficiently identify relevant variables, improving model accuracy and practical application.

Keywords:
Conditional permutationFalse positive ratesSparsitySure independence screeningVariable selection

More Related Videos

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

2.9K
Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms
08:51

Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms

Published on: November 1, 2019

5.0K

Related Experiment Videos

Last Updated: Apr 22, 2026

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

15.2K
Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach
04:35

Development of an Individual-Tree Basal Area Increment Model using a Linear Mixed-Effects Approach

Published on: July 3, 2020

2.9K
Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms
08:51

Statistical Modelling of Cortical Connectivity Using Non-invasive Electroencephalograms

Published on: November 1, 2019

5.0K

Area of Science:

  • Statistics
  • Nonparametric Statistics
  • High-Dimensional Data Analysis

Background:

  • Varying-coefficient models are crucial for analyzing how covariate effects change with exposure.
  • Variable selection is a challenge in these models, especially with a large number of covariates.
  • Sparse ultra-high dimensional settings require efficient screening methods.

Purpose of the Study:

  • To propose and investigate marginal nonparametric screening methods for variable selection in sparse ultra-high dimensional varying-coefficient models.
  • To establish the sure independent screening property and quantify dimensionality reduction.
  • To enhance practical utility and finite sample performance through data-driven iterative methods.

Main Methods:

  • Nonparametric Independence Screening (NIS) ranks covariates based on their marginal nonparametric contributions.
  • Theoretical properties, including the sure independent screening property, are established under mild conditions.
  • Two iterative methods, Conditional-INIS and Greedy-INIS, are developed for parameter and variable selection.

Main Results:

  • The proposed NIS method demonstrates the sure independent screening property for nonpolynomial dimensionality.
  • Dimensionality reduction is quantified for the NIS method.
  • Simulation studies and real data applications show the effectiveness and flexibility of Conditional-INIS and Greedy-INIS.

Conclusions:

  • Marginal nonparametric screening methods provide an effective approach for variable selection in high-dimensional varying-coefficient models.
  • The proposed iterative methods improve practical performance and applicability.
  • The developed techniques are robust and versatile for complex statistical modeling challenges.