Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Aggregates Classification01:29

Aggregates Classification

963
Aggregate classification is generally based on its size, petrographic characteristics, weight, and source. Size classification ranges from coarse to fine aggregates, defined by the size of the particles. Coarse aggregates are particles that do not pass through ASTM sieve No. 4, and aggregates that pass through the sieve are fine aggregates.
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
963
Mechanistic Models: Compartment Models in Individual and Population Analysis01:23

Mechanistic Models: Compartment Models in Individual and Population Analysis

241
Mechanistic models are utilized in individual analysis using single-source data, but imperfections arise due to data collection errors, preventing perfect prediction of observed data. The mathematical equation involves known values (Xi), observed concentrations (Ci), measurement errors (εi), model parameters (ϕj), and the related function (ƒi) for i number of values. Different least-squares metrics quantify differences between predicted and observed values. The ordinary least...
241
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

282
Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
282
Variation01:19

Variation

7.7K
An important characteristic of any set of data is the variation in the data. In some data sets, the data values are concentrated closely near the mean; in other data sets, the data values are more widely spread out from the mean. The most common measure of variation, or spread, is the standard deviation, which is the square root of variance.
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
7.7K
Random Error01:04

Random Error

7.8K
Random or indeterminate errors originate from various uncontrollable variables, such as variations in environmental conditions, instrument imperfections, or the inherent variability of the phenomena being measured. Usually, these errors cannot be predicted, estimated, or characterized because their direction and magnitude often vary in magnitude and direction even during consecutive measurements. As a result, they are difficult to eliminate. However, the aggregate effect of these errors can be...
7.8K
Regression Toward the Mean01:52

Regression Toward the Mean

6.8K
Regression toward the mean (“RTM”) is a phenomenon in which extremely high or low values—for example, and individual’s blood pressure at a particular moment—appear closer to a group’s average upon remeasuring. Although this statistical peculiarity is the result of random error and chance, it has been problematic across various medical, scientific, financial and psychological applications. In particular, RTM, if not taken into account, can interfere when...
6.8K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

GeneSEA Explorer: An R Shiny Tool for Differential Gene Expression Analysis With Shannon's Entropy Aggregation.

Biotechnology and bioengineering·2026
Same author

Copy number variants reveal divergent genetic and diagnostic cortical signatures across psychiatric disorders.

Research square·2026
Same author

National recommendations for the safe handling of hazardous drugs by pharmacy technicians in Portugal: A modified delphi study.

Journal of oncology pharmacy practice : official publication of the International Society of Oncology Pharmacy Practitioners·2026
Same author

Circadian Health Training in Latin America: Translating Chronobiology into Clinical Practice.

Sleep science (Sao Paulo, Brazil)·2026
Same author

Actigraphy-Based Movement Profiles and Their Association With Circadian Rhythms Integrity in Real-World Settings.

Journal of biological rhythms·2026
Same author

Targeting NRF2 With Isoeugenol: A Promising Small Molecule for Neurodegenerative, Metabolic, and Chronic Inflammatory Disorders.

Oxidative medicine and cellular longevity·2026
Same journal

Research on a Regional Availability Evaluation Model for Road-Area High-Entropy Energy Based on Synergy Factors.

Entropy (Basel, Switzerland)·2026
Same journal

Atmospheric Turbulence Channel Modeling and Performance Analysis of a CO-ZP-OFDM Coherent Optical Communication System for UAV Air-to-Ground Scenarios.

Entropy (Basel, Switzerland)·2026
Same journal

Information Geometry and Asymptotic Theory for SMML Estimators.

Entropy (Basel, Switzerland)·2026
Same journal

Correlation Entropy and Power-Law Kinetics.

Entropy (Basel, Switzerland)·2026
Same journal

Research on the Contagion of Systemic Financial Risk Under the Impact of Climate Risks-From the Perspective of Complex Networks and Machine Learning.

Entropy (Basel, Switzerland)·2026
Same journal

The Statistical-Mechanical Meaning of the Wave Function of Quantum Mechanics.

Entropy (Basel, Switzerland)·2026
See all related articles

Related Experiment Video

Updated: Jan 13, 2026

Probing the Limits of Egg Recognition Using Egg Rejection Experiments Along Phenotypic Gradients
07:34

Probing the Limits of Egg Recognition Using Egg Rejection Experiments Along Phenotypic Gradients

Published on: August 22, 2018

8.6K

Aggregation in Ill-Conditioned Regression Models: A Comparison with Entropy-Based Methods.

Ana Helena Tavares1,2, Ana Silva3, Tiago Freitas4

  • 1Center for Research and Development in Mathematics and Applications (CIDMA), 3810-193 Aveiro, Portugal.

Entropy (Basel, Switzerland)
|October 28, 2025
PubMed
Summary
This summary is machine-generated.

A new normalized entropy approach enhances precision accuracy in large-scale regression analysis compared to traditional methods like bagging and magging. This information-theoretic method offers advantages for inference problems, especially with noisy or collinear data.

Keywords:
big datacollinearitymaximum entropynormalized entropyregression modeling

More Related Videos

An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.5K
Establishing a Competing Risk Regression Nomogram Model for Survival Data
04:57

Establishing a Competing Risk Regression Nomogram Model for Survival Data

Published on: October 23, 2020

10.7K

Related Experiment Videos

Last Updated: Jan 13, 2026

Probing the Limits of Egg Recognition Using Egg Rejection Experiments Along Phenotypic Gradients
07:34

Probing the Limits of Egg Recognition Using Egg Rejection Experiments Along Phenotypic Gradients

Published on: August 22, 2018

8.6K
An R-Based Landscape Validation of a Competing Risk Model
05:37

An R-Based Landscape Validation of a Competing Risk Model

Published on: September 16, 2022

2.5K
Establishing a Competing Risk Regression Nomogram Model for Survival Data
04:57

Establishing a Competing Risk Regression Nomogram Model for Survival Data

Published on: October 23, 2020

10.7K

Area of Science:

  • Statistics
  • Information Theory
  • Data Science

Background:

  • Traditional regression methods struggle with large-scale data.
  • Aggregation methods like bagging and magging can falter with ill-conditioned data, particularly collinearity.
  • The Ordinary Least Squares (OLS) estimator poses risks in big data analysis, especially with collinearity.

Purpose of the Study:

  • To compare a novel normalized entropy approach with established methods (bagging, magging) for large-scale regression.
  • To evaluate performance in terms of prediction and precision accuracy.
  • To highlight the benefits of normalized entropy for inference in challenging datasets.

Main Methods:

  • A simulation study comparing normalized entropy with bagging and magging.
  • Analysis focused on prediction and precision accuracy metrics.
  • Evaluation under varying group sizes and observations per group.

Main Results:

  • Normalized entropy and aggregation methods showed similar prediction accuracy.
  • Normalized entropy significantly outperformed other methods in precision accuracy.
  • This advantage persisted even with fewer groups and observations.

Conclusions:

  • The normalized entropy approach offers superior precision accuracy for large-scale regression inference.
  • Caution is advised when using OLS estimators with collinear large-scale data.
  • The proposed strategies show potential for econometrics, genomics, environmental sciences, and machine learning.