Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Probability Laws01:49

Probability Laws

Overview
Binomial Probability Distribution01:15

Binomial Probability Distribution

A binomial distribution is a probability distribution for a procedure with a fixed number of trials, where each trial can have only two outcomes.
The outcomes of a binomial experiment fit a binomial probability distribution. A statistical experiment can be classified as a binomial experiment if the following conditions are met:
There are a fixed number of trials. Think of trials as repetitions of an experiment. The letter n denotes the number of trials.
There are only two possible outcomes,...
Contingency Table01:29

Contingency Table

A contingency table provides a way of portraying data that can facilitate calculating probabilities. It is a method of displaying a frequency distribution as a table with rows and columns to show how two variables may be dependent (contingent) upon each other; The table helps determine conditional probabilities quite quickly and can help systematically organize, analyze and quantify data. The table displays sample values concerning two variables that may be dependent or contingent on one...
Propagation of Uncertainty from Random Error00:59

Propagation of Uncertainty from Random Error

An experiment often consists of more than a single step. In this case, measurements at each step give rise to uncertainty. Because the measurements occur in successive steps, the uncertainty in one step necessarily contributes to that in the subsequent step. As we perform statistical analysis on these types of experiments, we must learn to account for the propagation of uncertainty from one step to the next. The propagation of uncertainty depends on the type of arithmetic operation performed on...
Propagation of Uncertainty from Systematic Error01:10

Propagation of Uncertainty from Systematic Error

The atomic mass of an element varies due to the relative ratio of its isotopes. A sample's relative proportion of oxygen isotopes influences its average atomic mass. For instance, if we were to measure the atomic mass of oxygen from a sample, the mass would be a weighted average of the isotopic masses of oxygen in that sample. Since a single sample is not likely to perfectly reflect the true atomic mass of oxygen for all the molecules of oxygen on Earth, the mass we obtain from this particular...
Survival Tree01:19

Survival Tree

Survival trees are a non-parametric method used in survival analysis to model the relationship between a set of covariates and the time until an event of interest occurs, often referred to as the "time-to-event" or "survival time." This method is particularly useful when dealing with censored data, where the event has not occurred for some individuals by the end of the study period, or when the exact time of the event is unknown.
 Building a Survival Tree
Constructing a survival tree begins...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Automatic identification of solid-phase medication intake using wireless wearable accelerometers.

Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference·2015
Same author

Design of an expert system for mitigating trace element toxicity in cancer risk management.

Cancer informatics·2013
Same author

Design of a smart biomarker for bioremediation: a machine learning approach.

Computers in biology and medicine·2011
Same author

On the feature selection criterion based on an approximation of multidimensional mutual information.

IEEE transactions on pattern analysis and machine intelligence·2010
Same author

Reduction of noise due to systematic uncertainties in 113mIn SPECT imaging using information theory.

Computers in biology and medicine·2009
Same author

A parallel decision tree-based method for user authentication based on keystroke patterns.

IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society·2005

Related Experiment Video

Updated: Jul 12, 2026

Creating Objects and Object Categories for Studying Perception and Perceptual Learning
14:38

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

On the relationship between dependence tree classification error and Bayes error rate.

Kiran S Balagani1, Vir V Phoha

  • 1Computer Science, College of Engineering and Science, Louisiana Tech University, Ruston, LA 71272, USA. ksb011@latech.edu

IEEE Transactions on Pattern Analysis and Machine Intelligence
|August 19, 2007
PubMed
Summary

This study corrects an expansion of conditional entropy H(w|X) used to derive Chow and Liu

More Related Videos

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation
06:09

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Related Experiment Videos

Last Updated: Jul 12, 2026

Creating Objects and Object Categories for Studying Perception and Perceptual Learning
14:38

Creating Objects and Object Categories for Studying Perception and Perceptual Learning

Published on: November 2, 2012

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment
12:18

A Machine Learning Approach to Design an Efficient Selective Screening of Mild Cognitive Impairment

Published on: January 11, 2020

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation
06:09

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Area of Science:

  • Information Theory
  • Machine Learning
  • Statistical Inference

Background:

  • Chow and Liu's tree dependence approximation is a key method in graphical models.
  • Wong and Poon previously linked this approximation to Bayes error rate minimization.
  • Their derivation involved expanding conditional entropy H(w|X).

Purpose of the Study:

  • To derive the correct expansion of conditional entropy H(w|X).
  • To re-evaluate the implications of this expansion for Chow and Liu's approximation.
  • To clarify the relationship between Bayes error rate and tree dependence approximation.

Main Methods:

  • Information-theoretic analysis
  • Mathematical derivation of entropy expansion
  • Comparison with previous work by Wong and Poon

Main Results:

  • A corrected expansion for conditional entropy H(w|X) was established.
  • The implications of this corrected expansion for the Bayes error rate were analyzed.
  • Discrepancies with Wong and Poon's previous derivation were identified.

Conclusions:

  • The corrected entropy expansion offers a more accurate theoretical basis for understanding tree dependence approximation.
  • This finding refines the connection between error rate minimization and graphical model approximations.
  • Further research can build upon this corrected expansion for improved statistical inference.