Related Experiment Video
Updated: May 26, 2026

06:22
A Precise and Autonomous System for the Detection of Insect Emergence Patterns
Published on: January 9, 2019
Quantitative assessment of the log-log-step method for pattern detection in noise-prone environments
1Institute of Neuroinformatics, ETH Zurich and University of Zurich, Zurich, Switzerland.
Plos One
|December 17, 2011
Summary
This study reveals staircase patterns in time series data, even with significant noise and jitter. A new method and analytical bounds help identify periodicity in complex, noisy datasets.
Area of Science:
- Complex Systems Analysis
- Time Series Analysis
- Signal Processing
Background:
- Identifying periodic patterns in time series is challenging due to noise and jitter.
- Log-log correlation plots can reveal underlying structures in data.
- Existing methods struggle with high levels of noise and jitter.
Purpose of the Study:
- To analyze a method for detecting staircase-like patterns in noisy time series.
- To quantitatively assess the method's performance under various noise and jitter conditions.
- To derive theoretical bounds for pattern detection in ideal scenarios.
Main Methods:
- Analysis of log-log correlation plots for staircase structures.
- Quantitative measurement of method performance across different noise/jitter combinations.
- Novel analytical derivation of bounds for observable steps.
Main Results:
- Staircase structures are detectable even with strong jitter and noise.
- A phase diagram illustrates the method's robustness under unfavorable conditions.
- Analytical bounds for ideal noiseless cases were derived.
Conclusions:
- The developed method shows significant potential for identifying periodicity in noisy data.
- Quantitative measures and ideal bounds provide guidelines for practical application.
- The findings advance the ability to detect patterns in real-world complex systems.
Related Concept Videos
Wald-Wolfowitz Runs Test II
The Wald-Wolfowitz runs test, commonly referred to as the runs test, is a nonparametric test used to assess the randomness of ordered data. The test evaluates the number of runs, which are consecutive sequences of similar elements within the data. If the number of runs is significantly higher or lower than expected, the data is considered non-random, indicating a detectable pattern or structure.
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...
For binary data, runs are identified using symbols such as + and −, or equivalently, 1s and 0s. In...
Difference from Background: Limit of Detection
The limit of detection (LOD) is the smallest amount of analyte that can be distinguished from the background noise. The LOD value corresponds to the concentration at which the analyte signal is three times larger than the standard deviation of the blank signal. Below this value, the analyte signal cannot be differentiated from the background noise. It is calculated by dividing the calibration slope by 3 times the standard deviation of the blank signals.
The LOD indicates the presence or absence...
The LOD indicates the presence or absence...
Wald-Wolfowitz Runs Test I
The Wald-Wolfowitz test, also known as the runs test, is a nonparametric statistical test used to assess the randomness of a sequence of two different types of elements (e.g., positive/negative values, successes/failures). It examines whether the order of the elements in a sequence is random or if there is a pattern or trend present. This nonparametric test applies to any ordered data despite the population and sample data distribution, even if a higher sample size is available.
The test works...
The test works...
Quantifying and Rejecting Outliers: The Grubbs Test
Sometimes, a data set can have a recorded numerical observation that greatly deviates from the rest of the data. Assuming that the data is normally distributed, a statistical method called the Grubbs test can be used to determine whether the observation is truly an outlier. To perform a two-tailed Grubbs test, first, calculate the absolute difference between the outlier and the mean. Then, calculate the ratio between this difference and the standard deviation of the sample. This number is...
Sign Test for Matched Pairs
The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples—often pre- and post-treatment measurements on the same subjects—to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in value between...
To conduct the sign test, we first calculate the differences in value between...
Detection of Gross Error: The Q Test
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...