Feature selection by higher criticism thresholding achieves the optimal phase diagram

David Donoho1, Jiashun Jin

  • 1Department of Statistics, Stanford University, Stanford, CA 94305, USA.

Summary

Feature selection for high-dimensional data is improved by higher criticism thresholding (HCT). HCT performs as well as ideal thresholding in the rare/weak model, outperforming false discovery rate methods.

Related Concept Videos

Phase Diagram01:19

Phase Diagram

The phase of a given substance depends on the pressure and temperature. Thus, plots of pressure versus temperature showing the phase in each region provide considerable insights into the thermal properties of substances. Such plots are known as phase diagrams. For instance, in the phase diagram for water (Figure 1), the solid curve boundaries between the phases indicate phase transitions (i.e., temperatures and pressures at which the phases coexist).
Phase Diagram01:24

Phase Diagram

A phase diagram is a graphical representation of the physical states of a substance under different conditions of temperature and pressure. It shows the boundaries between solid, liquid, and gas phases and the conditions at which these phases coexist in equilibrium. An area in a phase diagram represents a single phase, whereas lines or phase boundaries represent the equilibrium between two phases.In the phase diagram of water, the boundary line between the solid and liquid states illustrates...
Phase Contrast and Differential Interference Contrast Microscopy01:26

Phase Contrast and Differential Interference Contrast Microscopy

Phase-Contrast Microscopes
In-phase-contrast microscopes, interference between light directly passing through a cell and light refracted by cellular components is used to create high-contrast, high-resolution images without staining. It is the oldest and simplest type of microscope that creates an image by altering the wavelengths of light rays passing through the specimen. Altered wavelength paths are created using an annular stop in the condenser. The annular stop produces a hollow cone of...
Phase Diagrams02:39

Phase Diagrams

A phase diagram combines plots of pressure versus temperature for the liquid-gas, solid-liquid, and solid-gas phase-transition equilibria of a substance. These diagrams indicate the physical states that exist under specific conditions of pressure and temperature and also provide the pressure dependence of the phase-transition temperatures (melting points, sublimation points, boiling points). Regions or areas labeled solid, liquid, and gas represent single phases, while lines or curves represent...
Optimizing Chromatographic Separations01:15

Optimizing Chromatographic Separations

Optimizing chromatographic separations is crucial for obtaining clean separations in a minimum amount of time. Optimization is required for several factors, including kinetic effects related to band broadening, plate height, capacity factor, and separation factor.
Band broadening refers to spreading solute bands as they travel through the column. This broadening can impact resolution. Plate height (H) represents the length required for one theoretical plate. A lower plate height corresponds to...
Phase Transitions: Melting and Freezing02:39

Phase Transitions: Melting and Freezing

Heating a crystalline solid increases the average energy of its atoms, molecules, or ions, and the solid gets hotter. At some point, the added energy becomes large enough to partially overcome the forces holding the molecules or ions of the solid in their fixed positions, and the solid begins the process of transitioning to the liquid state or melting. At this point, the temperature of the solid stops rising, despite the continual input of heat, and it remains constant until all of the solid is...