Entropy estimation of symbol sequences

Thomas Schurmann1, Peter Grassberger

  • 1Department of Theoretical Physics, University of Wuppertal, D-42097 Wuppertal, Germany.

Chaos (Woodbury, N.Y.)
|September 1, 1996
PubMed

Related Concept Videos

Maxam-Gilbert Sequencing01:05

Maxam-Gilbert Sequencing

In the same year as the discovery of the Sanger sequencing method, another group of scientists, Allan Maxam and Walter Gilbert, demonstrated their chemical-cleavage method for DNA sequencing. The Maxam-Gilbert method relies on using different chemicals that can cleave the DNA sequence at specific sites, the separation of resulting DNA fragments of variable size using electrophoresis, and deciphering the DNA sequence from the resulting gel bands.
Challenges of the Maxam-Gilbert Method
The...
Determination of Expected Frequency01:08

Determination of Expected Frequency

Suppose one wants to test independence between the two variables of a contingency table. The values in the table constitute the observed frequencies of the dataset. But how does one determine the expected frequency of the dataset? One of the important assumptions is that the two variables are independent, which means the variables do not influence each other. For independent variables, the statistical probability of any event involving both variables is calculated by multiplying the individual...
Mass Spectrum: Interpretation01:24

Mass Spectrum: Interpretation

An unknown compound can be established by identifying the molecular ion peak in the mass spectrum. The molecular ion peak is often weak or absent due to the predominance of fragmentation in high-energy electron beams. In such cases, a soft-energy electron beam can be used to scan the spectrum to enhance the intensity of the molecular ion peak. Additionally, chemical ionization, field ionization, and desorption ionization spectra are used to obtain a relatively intense molecular ion peak.To...
Estimation of the Physical Quantities01:05

Estimation of the Physical Quantities

On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
Basic Discrete Time Signals01:16

Basic Discrete Time Signals

The unit step sequence is defined as 1 for zero and positive values of the integer n. This sequence can be graphically displayed using a set of eight sample points, showing a step function starting from n=0 and remaining constant thereafter.
The unit impulse or sample sequence is mathematically expressed as zero for all n values except at n=0, where it is one. The unit impulse sequence, denoted by δ(n), is the first difference of the unit step sequence, while the unit step sequence u(n) is the...
Sequences01:29

Sequences

Sequences are fundamental mathematical objects consisting of ordered lists of numbers that follow a specific rule or pattern. Sequences are critical in various mathematical concepts, including calculus, series, and number theory. They can model real-world phenomena such as population growth, financial investments, and physical processes like the diminishing height of a bouncing ball.Each number in a sequence is referred to as a term. Typically, the terms are denoted as a1, a2, a3,…, where the...