Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Always Good Turing: asymptotically optimal probability estimation.

Alon Orlitsky1, Narayana P Santhanam, Junan Zhang

  • 1Department of Electrical and Computer Engineering, University of California, San Diego, La Jolla, CA 92093, USA. alon@ucsd.edu

Science (New York, N.Y.)
|October 18, 2003
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

3d Transition metal and nitrogen co-doped graphene: first-principles study of electronic structure and optical properties.

Physical chemistry chemical physics : PCCP·2026
Same author

Artificial Intelligence Enhanced Electrocardiogram Analysis for Age and Sex Classification in Youth.

Pediatric cardiology·2026
Same author

Artificial Intelligence Enhanced Electrocardiogram Analysis for Age and Sex Classification in Youth.

Research square·2025
Same author

Inflammasomes: potential therapeutic targets in hematopoietic stem cell transplantation.

Cell communication and signaling : CCS·2024
Same author

A review of lactate-lactylation in malignancy: its potential in immunotherapy.

Frontiers in immunology·2024
Same author

Work Function Prediction by Graph Neural Networks for Configurationally Hybridized Boron-Doped Graphene.

Langmuir : the ACS journal of surfaces and colloids·2024
Same journal

Erratum for the Research Article "Detecting supramolecular organic nanoparticles during heat wave".

Science (New York, N.Y.)·2026
Same journal

Local signals, systemic decline.

Science (New York, N.Y.)·2026
Same journal

The mechanics of liver regeneration.

Science (New York, N.Y.)·2026
Same journal

Computing in a memory with physics.

Science (New York, N.Y.)·2026
Same journal

Retraction.

Science (New York, N.Y.)·2026
Same journal

Making time.

Science (New York, N.Y.)·2026
See all related articles

Researchers analyzed probability estimators, finding that the Good-Turing estimator has low attenuation. A new estimator was developed with an attenuation of 1, ensuring it does not underestimate sequence probabilities.

Area of Science:

  • Statistics
  • Information Theory
  • Computer Science

Background:

  • The Good-Turing estimator, developed during Enigma code decryption, is a key method for probability estimation from data samples.
  • Understanding the limitations of probability estimators is crucial for accurate data analysis and sequence probability assignments.

Purpose of the Study:

  • To define and analyze the attenuation of probability estimators.
  • To compare the attenuation of common estimators, including the Good-Turing estimator.
  • To develop a novel estimator with minimal attenuation.

Main Methods:

  • Defining attenuation as the maximum ratio of probabilities assigned by any distribution versus the estimator.
  • Evaluating the attenuation of existing common estimators.

Related Experiment Videos

  • Deriving a new probability estimator with a specific attenuation property.
  • Main Results:

    • Some common probability estimators exhibit infinite attenuation.
    • The Good-Turing estimator demonstrates low, but greater than 1, attenuation.
    • A new estimator was successfully derived with an attenuation of 1.

    Conclusions:

    • The newly derived estimator asymptotically avoids underestimating sequence probabilities.
    • This new estimator offers improved theoretical guarantees compared to existing methods.
    • The concept of attenuation provides a valuable metric for evaluating probability estimators.