Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Maximum entropy and Bayesian data analysis: Entropic prior distributions.

Ariel Caticha1, Roland Preuss

  • 1Physics Department, State University of New York at Albany, Albany, New York 12222, USA.

Physical Review. E, Statistical, Nonlinear, and Soft Matter Physics
|December 17, 2004
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Entropic Dynamics Approach to Quantum Electrodynamics.

Entropy (Basel, Switzerland)·2025
Same author

Entropic Dynamics Approach to Relational Quantum Mechanics.

Entropy (Basel, Switzerland)·2025
Same author

What Is Ontic and What Is Epistemic in the Quantum Mechanics of Spin?

Entropy (Basel, Switzerland)·2025
Same author

Entropic Density Functional Theory.

Entropy (Basel, Switzerland)·2024
Same author

Outlier-Robust Surrogate Modeling of Ion-Solid Interaction Simulations.

Entropy (Basel, Switzerland)·2023
Same author

Entropy, Information, and the Updating of Probabilities.

Entropy (Basel, Switzerland)·2021
Same journal

Tension on dsDNA bound to ssDNA-RecA filaments may play an important role in driving efficient and accurate homology recognition and strand exchange.

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Amplitude-phase coupling drives chimera states in globally coupled laser networks [Phys. Rev. E 91, 040901(R) (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Erratum: Shapes of sedimenting soft elastic capsules in a viscous fluid [Phys. Rev. E 92, 033003 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Erratum: Attenuation of excitation decay rate due to collective effect [Phys. Rev. E 90, 022142 (2014)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Role of connectivity and fluctuations in the nucleation of calcium waves in cardiac cells [Phys. Rev. E 92, 052715 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
Same journal

Publisher's Note: Lattice Boltzmann approach for complex nonequilibrium flows [Phys. Rev. E 92, 043308 (2015)].

Physical review. E, Statistical, nonlinear, and soft matter physics·2016
See all related articles

This study introduces a maximum entropy method to create prior probability distributions for Bayesian analysis, overcoming a key challenge in data analysis. This approach ensures priors accurately reflect experimental information, enhancing Bayesian inference reliability.

Area of Science:

  • Bayesian data analysis
  • Statistical inference
  • Information theory

Background:

  • Assigning accurate prior probability distributions is a significant challenge in Bayesian data analysis.
  • Existing methods often struggle to incorporate all available prior experimental information effectively.

Purpose of the Study:

  • To develop a principled method for constructing prior distributions in Bayesian inference.
  • To leverage the principle of maximum relative entropy (ME) for translating experimental information into priors.
  • To address the stumbling blocks in Bayesian data analysis related to prior specification.

Main Methods:

  • The study employs the maximum relative entropy (ME) method.
  • Information from the likelihood function's form is used to derive the prior distribution.

Related Experiment Videos

  • The approach is inspired by applications of ME in statistical mechanics.

    • Main Results:

    • The proposed "entropic prior" is formally identical to the Einstein fluctuation formula for non-repeatable experiments.
    • For repeatable experiments, the expected value of the likelihood's entropy is identified as crucial information.
    • A detailed analysis is provided for the specific case of a Gaussian likelihood.

    Conclusions:

    • The maximum entropy method offers a robust framework for Bayesian prior construction.
    • The entropic prior effectively incorporates experimental information, improving Bayesian analysis.
    • The findings are particularly relevant for statistical mechanics and data analysis involving Gaussian likelihoods.