Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Introduction to Test of Independence01:21

Introduction to Test of Independence

2.3K
In statistics, the term independence means that one can directly obtain the probability of any event involving both variables by multiplying their individual probabilities. Tests of independence are chi-square tests involving the use of a contingency table of observed (data) values.
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
2.3K
Hypothesis Test for Test of Independence01:16

Hypothesis Test for Test of Independence

3.6K
The test of independence is a chi-square-based test used to determine whether two variables or factors are independent or dependent. This hypothesis test is used to examine the independence of the variables. One can construct two qualitative survey questions or experiments based on the variables in a contingency table. The goal is to see if the two variables are unrelated (independent) or related (dependent). The null and alternative hypotheses for this test are:
H0: The two variables (factors)...
3.6K
Wald-Wolfowitz Runs Test II01:17

Wald-Wolfowitz Runs Test II

246
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and...
246
Test for Homogeneity01:23

Test for Homogeneity

2.0K
The goodness–of–fit test can be used to decide whether a population fits a given distribution, but it will not suffice to decide whether two populations follow the same unknown distribution. A different test, called the test for homogeneity, can be used to conclude whether two populations have the same distribution. To calculate the test statistic for a test for homogeneity, follow the same procedure as with the test of independence. The hypotheses for the test for homogeneity can...
2.0K
Wald-Wolfowitz Runs Test I01:17

Wald-Wolfowitz Runs Test I

655
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
655
Expected Frequencies in Goodness-of-Fit Tests01:19

Expected Frequencies in Goodness-of-Fit Tests

2.5K
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n)  to the number of categories (k).
2.5K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Transfer Entropy Granger Causality between News Indices and Stock Markets in U.S. and Latin America during the COVID-19 Pandemic.

Entropy (Basel, Switzerland)·2023
Same author

On the Fitness Functions Involved in Genetic Algorithms and the Cryptanalysis of Block Ciphers.

Entropy (Basel, Switzerland)·2023
Same author

Conscious Exploration of Alpha-Cuts in the Parametric Solution of the School Bus Routing Problem with Fuzzy Walking Distance.

Computational intelligence and neuroscience·2022
Same author

Detection of DIAG and LINE Patterns in PassPoints Graphical Passwords Based on the Maximum Angles of Their Delaunay Triangles.

Sensors (Basel, Switzerland)·2022
Same author

Information Theory Based Evaluation of the RC4 Stream Cipher Outputs.

Entropy (Basel, Switzerland)·2021
Same author

Selecting an Effective Entropy Estimator for Short Sequences of Bits and Bytes with Maximum Entropy.

Entropy (Basel, Switzerland)·2021
Same journal

Research on a Regional Availability Evaluation Model for Road-Area High-Entropy Energy Based on Synergy Factors.

Entropy (Basel, Switzerland)·2026
Same journal

Atmospheric Turbulence Channel Modeling and Performance Analysis of a CO-ZP-OFDM Coherent Optical Communication System for UAV Air-to-Ground Scenarios.

Entropy (Basel, Switzerland)·2026
Same journal

Information Geometry and Asymptotic Theory for SMML Estimators.

Entropy (Basel, Switzerland)·2026
Same journal

Correlation Entropy and Power-Law Kinetics.

Entropy (Basel, Switzerland)·2026
Same journal

Research on the Contagion of Systemic Financial Risk Under the Impact of Climate Risks-From the Perspective of Complex Networks and Machine Learning.

Entropy (Basel, Switzerland)·2026
Same journal

The Statistical-Mechanical Meaning of the Wave Function of Quantum Mechanics.

Entropy (Basel, Switzerland)·2026
See all related articles

Related Experiment Video

Updated: Jul 10, 2025

Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans
09:23

Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans

Published on: August 16, 2017

8.1K

Complexity Reduction in Analyzing Independence between Statistical Randomness Tests Using Mutual Information.

Jorge Augusto Karell-Albo1, Carlos Miguel Legón-Pérez1, Raisa Socorro-Llanes2

  • 1Instituto de Criptografía, Facultad de Matemática y Computación, Universidad de la Habana, Habana 10400, Cuba.

Entropy (Basel, Switzerland)
|November 24, 2023
PubMed
Summary
This summary is machine-generated.

This study simplifies mutual information analysis for randomness tests, reducing computational complexity without losing correlation detection accuracy. The efficient method is recommended for analyzing statistical test batteries.

Keywords:
PRNGcomplexitycryptographymutual information

More Related Videos

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.6K
Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time
07:12

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

12.3K

Related Experiment Videos

Last Updated: Jul 10, 2025

Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans
09:23

Quantification of Information Encoded by Gene Expression Levels During Lifespan Modulation Under Broad-range Dietary Restriction in C. elegans

Published on: August 16, 2017

8.1K
How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study
05:33

How to Calculate and Validate Inter-brain Synchronization in a fNIRS Hyperscanning Study

Published on: September 8, 2021

6.6K
Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time
07:12

Using Informational Connectivity to Measure the Synchronous Emergence of fMRI Multi-voxel Information Across Time

Published on: July 1, 2014

12.3K

Area of Science:

  • Information Theory
  • Statistical Analysis
  • Randomness Testing

Background:

  • Mutual information effectively evaluates correlations between randomness tests.
  • High computational complexity limits the application of mutual information for large test batteries.

Purpose of the Study:

  • To reduce the complexity of mutual information-based methods for analyzing the independence of statistical randomness tests.
  • To propose a modified method that maintains correlation detection capabilities while improving efficiency.

Main Methods:

  • Theoretical estimation and experimental verification of complexity reduction.
  • Modification of the mutual information significance determination step.
  • Analysis of correlations within the NIST (National Institute of Standards and Technology) battery of randomness tests.

Main Results:

  • A significant reduction in the computational complexity of the mutual information method was achieved.
  • The proposed variant method demonstrated comparable correlation detection performance to the original method.
  • The modified method's efficiency was experimentally validated.

Conclusions:

  • The modified mutual information method offers a more efficient approach to analyzing statistical test independence.
  • The method's effectiveness in detecting correlations remains robust.
  • The proposed technique is recommended for broader application in analyzing various batteries of randomness tests.