Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

How Data are Classified: Categorical Data

How Data are Classified: Categorical Data

A variable, usually notated by capital letters such as X and Y, is a characteristic or measurement that can be determined for each member of a population. Data are the actual values of variables. They may be numbers, or they may be words. Datum is a single value.
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...

Quantifying and Rejecting Outliers: The Grubbs Test

Quantifying and Rejecting Outliers: The Grubbs Test

Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This...

Expected Frequencies in Goodness-of-Fit Tests

Expected Frequencies in Goodness-of-Fit Tests

A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).

Classification of Signals

Classification of Signals

In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...

Classification of Systems-II

Classification of Systems-II

Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A diagnostic performance study of multiplex polymerase chain reaction-based targeted next-generation sequencing for the accurate identification of <i>Mycobacterium</i> tuberculosis in bronchoalveolar lavage fluid.

Frontiers in cellular and infection microbiology·2026

Same author

An electroactive platform enabled by near-field communication for accelerating infected diabetic wound healing via directional electric field reshaping and immunomodulation.

Regenerative biomaterials·2026

Same author

Delphinidin targets voltage-dependent anion channel 1 to inhibit ferroptosis and protect against retinal photochemical damage.

Phytomedicine : international journal of phytotherapy and phytopharmacology·2026

Same author

Genome-wide analysis of the <i>GID</i> gene family in soybean and analysis of expression under gibberellin treatment.

Frontiers in plant science·2026

Same author

Decentralized EM algorithm for Gaussian mixtures under data heterogeneity and partial labeling.

Biometrics·2026

Same author

Community structure and metabolite profiles of psychrophiles and thermophiles in bovine raw milk from arid inland areas.

Applied and environmental microbiology·2026

Search research articles

Related Experiment Video

Updated: Apr 21, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

Feature Screening for Ultrahigh Dimensional Categorical Data with Applications.

Danyang Huang¹, Runze Li¹, Hansheng Wang¹

¹Peking University & Pennsylvania State University.

Journal of Business & Economic Statistics : a Publication of the American Statistical Association

|October 21, 2014

Summary

This study introduces a Pearson chi-square method for feature screening in ultrahigh dimensional categorical data. The procedure effectively identifies important variables and interactions, demonstrating screening consistency for big data analysis.

Keywords:

Feature Screening Pearson’s Chi-Square Test Screening Consistency Search Engine Marketing Text Classification Ultrahigh Dimensional Data

More Related Videos

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

Related Experiment Videos

Last Updated: Apr 21, 2026

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

Area of Science:

Statistics
Data Science
Machine Learning

Background:

Ultrahigh dimensional data with categorical responses and covariates are common in big data analysis.
Feature screening is crucial for identifying relevant variables in such datasets.

Purpose of the Study:

To propose a novel Pearson chi-square based feature screening procedure for ultrahigh dimensional categorical data.
To enable the detection of important interaction effects within these datasets.
To establish the screening consistency property of the proposed method.

Main Methods:

Development of a Pearson chi-square statistic tailored for categorical response and ultrahigh dimensional categorical covariates.
Theoretical analysis to prove the screening consistency property (following Fan and Lv, 2008).
Validation through Monte Carlo simulation studies and application to two empirical datasets.

Main Results:

The proposed Pearson chi-square screening procedure effectively identifies relevant features in ultrahigh dimensional categorical data.
The method successfully detects important interaction effects.
The procedure demonstrates theoretical screening consistency.

Conclusions:

The proposed Pearson chi-square based feature screening method is a valuable tool for analyzing ultrahigh dimensional categorical data.
It offers a statistically sound approach for variable and interaction selection in big data.
The method's performance is validated through simulations and real-world data applications.