Categorical Exploratory Data Analysis: From Multiclass Classification and Response Manifold Analytics Perspectives of
Fushing Hsieh1, Elizabeth P Chou2
1Department of Statistics, University of California at Davis, Davis, CA 95616, USA.
Entropy (Basel, Switzerland)
|July 2, 2021
Summary
Categorical Exploratory Data Analysis (CEDA) reveals universal feature associations using histograms and heatmaps. This approach enhances multiclass classification and response manifold analytics, offering new insights into data structures.
Area of Science:
- Data Science
- Machine Learning
- Statistical Analysis
Background:
- All data features possess an inherent categorical nature, observable through histograms.
- Feature associations can be quantified using contingency tables and rescaled conditional Shannon entropies.
- A heatmap of mutual associations serves as a roadmap for understanding feature relationships.
Purpose of the Study:
- To introduce Categorical Exploratory Data Analysis (CEDA), a novel data analysis paradigm.
- To apply CEDA to multiclass classification (MCC) and response manifold analytics (RMA).
- To compute visible and explainable information content with multiscale and heterogeneous structures.
Main Methods:
- Developing CEDA based on a heatmap of feature mutual associations.
- Utilizing histograms and contingency tables to determine feature associations.
- Applying CEDA to MCC using label embedding trees and indirect distance measures.
- Employing CEDA for RMA by analyzing multi-dimensional manifolds and identifying categorical localities.
Main Results:
- CEDA provides new resolutions for MCC and RMA.
- The method reveals asymmetric mixing geometries in high-dimensional point-clouds for MCC.
- RMA identifies major and minor effects within multi-dimensional manifolds.
- Information content and predictive inferences are computed for both MCC and RMA.
Conclusions:
- CEDA offers a robust framework for exploring categorical data structures.
- The approach enhances understanding of complex data relationships and system dynamics.
- CEDA demonstrates practical applications in diverse datasets, including Iris and PITCHf/x data.
Related Concept Videos
How Data are Classified: Categorical Data
38.9K
A variable, usually notated by capital letters such as X and Y, is a characteristic or measurement that can be determined for each member of a population. Data are the actual values of variables. They may be numbers, or they may be words. Datum is a single value.
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
Data are classified based on whether they are measurable or not. Categorical data cannot be measured; instead, it can be divided into categories. For example, if Y denotes a person's party affiliation, some examples of Y include...
38.9K
Response Surface Methodology
342
Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
The process of RSM involves several key steps:
342
Classification of Signals
1.0K
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
1.0K
How Data are Classified: Numerical Data
33.9K
Data that are countable or measurable in specific units are called numerical or quantitative data. Quantitative data are always numbers. Quantitative data are the result of counting or measuring the attributes of a population. Amount of money, pulse rate, weight, number of people living in a town, and number of students who opt for statistics are examples of quantitative data.
Quantitative data may be either discrete or continuous. All quantitative data that take on only specific numerical...
Quantitative data may be either discrete or continuous. All quantitative data that take on only specific numerical...
33.9K
Statistical Analysis: Overview
11.0K
When we take repeated measurements on the same or replicated samples, we will observe inconsistencies in the magnitude. These inconsistencies are called errors. To categorize and characterize these results and their errors, the researcher can use statistical analysis to determine the quality of the measurements and/or suitability of the methods.
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
11.0K
Classification of Systems-II
273
Continuous-time systems have continuous input and output signals, with time measured continuously. These systems are generally defined by differential or algebraic equations. For instance, in an RC circuit, the relationship between input and output voltage is expressed through a differential equation derived from Ohm's law and the capacitor relation,
273


