A swarm intelligence approach to density function reconstruction from moments using entropy optimization
Parthapratim Biswas1,2, Stephen R Elliott1,3,4
1Trinity College, University of Cambridge, Cambridge CB2 1TQ, United Kingdom.
None:
This paper presents a bioinspired optimization approach to address a class of inverse problems involving entropy optimization (EOP) from knowledge of the moments of a distribution function. In particular, we study the Hausdorff moment problem, where one seeks to reconstruct a (probability) density distribution by inverting a completely monotonic sequence of moments of the distribution in a bounded interval. It is shown that the resulting EOP can be handled very efficiently using the collective intelligence of a swarm (of optimizers), which provides a robust and accurate solution by effectively incorporating information from up to a thousand moments of the density. The efficacy of the approach is demonstrated by reconstructing the invariant density functions for the logistics map, spectral densities of large real-symmetric random matrices, encountered in the study of physics of disordered solids, and financial time series involving daily price fluctuations of a mutual fund. The agreement between true densities and the corresponding maximum-entropy approximants is examined by comparing the Kullback-Leibler divergence and the Fisher information of the densities.
Related Concept Videos
The Entropy as a State Function
Entropy
When an ideal gas expands isothermally, the disorder in the gas increases. From the molecular perspective, the gas molecules have more volume to move around in.
Consider an infinitesimal step in the expansion, which...
Entropy
Applications of Integration to Probability Density Functions
Cluster Sampling Method
To choose a cluster sample, divide the population into clusters (groups) and then randomly select some of the clusters. All the members from these clusters are in the cluster sample. For example, if you randomly sample four departments from your...
Maxwell-Boltzmann Distribution: Problem Solving
This distribution function f(v) is defined by saying that the expected number N (v1,v2) of particles with speeds between v1 and v2 is given by

