Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: Jun 9, 2025

Design and Analysis for Fall Detection System Simplification

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

A method to improve binary forecast skill verification.

Thitithep Sitthiyot¹, Kanyarat Holasut²

¹Department of Banking and Finance, Faculty of Commerce and Accountancy, Chulalongkorn University, Mahitaladhibesra Bld., 10th Fl., Phayathai Rd., Pathumwan, Bangkok 10330, Thailand.

|October 29, 2024

Summary

This summary is machine-generated.

Related Concept Videos

Improving Translational Accuracy

Improving Translational Accuracy

Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...

Prediction Intervals

Prediction Intervals

The interval estimate of any variable is known as the prediction interval. It helps decide if a point estimate is dependable.
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.

Detection of Gross Error: The Q Test

Detection of Gross Error: The Q Test

When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...

Accuracy and Errors in Hypothesis Testing

Accuracy and Errors in Hypothesis Testing

Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...

Confidence Coefficient

Confidence Coefficient

The confidence coefficient is also known as the confidence level or degree of confidence. It is the percent expression for the probability, 1-α, that the confidence interval contains the true population parameter assuming that the confidence interval is obtained after sufficient unbiased sampling; for example, if the CL = 90%, then in 90 out of 100 samples the interval estimate will enclose the true population parameter. Here α is the area under the curve, distributed equally under...

Accuracy, limits, and approximation

Accuracy, limits, and approximation

Accuracy, limits, and approximations are common in many fields, especially in engineering calculations. These concepts are imperative for ensuring that a given value is as close as possible to its true value.
Accuracy is defined as the closeness of the measured value to the true or actual value. In engineering mechanics, repeated measurements are taken during theoretical or experimental analyses to ensure that the result is precise and accurate.
The accuracy of any solution is based on the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A cross-country analysis of feasible income equality using the sigmoid function and the Boltzmann distribution.

PloS one·2025

Same author

Quantifying fair income distribution in Thailand.

PloS one·2024

Same author

A simple method for joint evaluation of skill in directional forecasts of multiple variables.

Heliyon·2023

Same author

Income distribution in Thailand is scale-invariant.

PloS one·2023

Same author

An investigation of the performance of parametric functional forms for the Lorenz curve.

PloS one·2023

Same author

A universal model for the Lorenz curve with novel applications for datasets containing zeros and/or exhibiting extreme inequality.

Scientific reports·2023

This study introduces an improvement factor to enhance forecast skill verification methods. It ensures accurate scoring for easy-to-predict events, improving forecast evaluation for forecasters.

Area of Science:

Meteorology
Economics

Background:

Existing deterministic binary forecast skill verification methods often award perfect scores for easily predictable events, misrepresenting forecast accuracy.
This limitation hinders the accurate assessment of forecaster skill, particularly for common or predictable occurrences.

Purpose of the Study:

To introduce an improvement factor that refines deterministic binary forecast skill verification.
To address the issue of overscoring perfect forecasts for events that are inherently easy to predict.

Main Methods:

Developed an improvement factor with two components: ease of forecasting and event frequency.
Validated the improvement factor using two hypothetical datasets.
Applied the factor to annual inflation rate forecast and actual data for practical assessment.

Keywords:

A method to improve binary forecast skill verification Binary event Deterministic forecast evaluation Direction-of-change Skill score

More Related Videos

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Related Experiment Videos

Last Updated: Jun 9, 2025

Design and Analysis for Fall Detection System Simplification

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Selecting Multiple Biomarker Subsets with Similarly Effective Binary Classification Performances

Published on: October 11, 2018

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

Published on: September 8, 2023

Main Results:

The improvement factor successfully adjusts scores for easy-to-forecast events, bringing them closer to no-skill forecast benchmarks.
Demonstrated that the enhanced methods provide a more realistic evaluation of forecast skill.
Empirical data confirmed the practical utility of the improvement factor in assessing forecaster performance.

Conclusions:

The proposed improvement factor enhances existing deterministic binary forecast skill verification methods.
This leads to more accurate and nuanced evaluation of forecast accuracy, especially for predictable events.
The method offers a practical tool for assessing forecaster skills in real-world scenarios.