Related Experiment Video
Updated: Sep 10, 2025

Applications of EEG Neuroimaging Data: Event-related Potentials, Spectral Power, and Multiscale Entropy
Published on: June 27, 2013
Enhancing Prediction by Incorporating Entropy Loss in Volatility Forecasting
Renaldas Urniezius1, Rytis Petrauskas1, Vygandas Vaitkus1
1Department of Automation, Kaunas University of Technology, Studentu St. 48, 51367 Kaunas, Lithuania.
Abstract:
In this paper, we propose examining Heterogeneous Autoregressive (HAR) models using five different estimation techniques and four different estimation horizons to decide which performs better in terms of forecasting accuracy. Several different estimators are used to determine the coefficients of three selected HAR-type models. Furthermore, model lags, calculated using 5 min intraday data from the Standard & Poor's 500 (SPX) index and the Chicago Board Options Exchange Volatility (VIX) index as the sole exogenous variable, enrich the models. For comparison and evaluation of the experimental results, we use three metrics: Quasi-Likelihood (QLIKE), Mean Absolute Error (MAE), and Mean Squared Error (MSE). An empirical study reveals that the Entropy Loss Function consistently achieves the best QLIKE results in all the horizons, especially in the weekly horizon. On the other hand, the performance of the Robust Linear Model implies that it can provide an alternative to the Entropy Loss Function when considering the results of the MAE and MSE metrics. Moreover, research shows that adding more informative lags, such as Realized Quarticity for the Heterogeneous Autoregressive model yielding the Realized Quarticity (HARQ) model, and incorporating the VIX index further improve the general results of the models. The results of the proposed Entropy Loss Function and Robust Linear Model suggest that they successfully achieve significant forecasting accuracy for HAR models across multiple forecasting horizons.
Related Concept Videos
Entropy Change in Reversible Processes
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Standard Entropy Change for a Reaction
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
Propagation of Uncertainty from Random Error
Propagation of Uncertainty from Systematic Error
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...

