Related Experiment Video
Updated: Sep 10, 2025

Applications of EEG Neuroimaging Data: Event-related Potentials, Spectral Power, and Multiscale Entropy
Published on: June 27, 2013
Enhancing Prediction by Incorporating Entropy Loss in Volatility Forecasting.
Renaldas Urniezius1, Rytis Petrauskas1, Vygandas Vaitkus1
1Department of Automation, Kaunas University of Technology, Studentu St. 48, 51367 Kaunas, Lithuania.
This study evaluates Heterogeneous Autoregressive (HAR) models for forecasting accuracy. The Entropy Loss Function and Robust Linear Model show superior performance across various horizons, especially with added Realized Quarticity and VIX index data.
Area of Science:
- Quantitative Finance
- Econometrics
- Financial Modeling
Background:
- Accurate financial market forecasting is crucial for risk management and investment strategies.
- Heterogeneous Autoregressive (HAR) models are widely used for volatility forecasting.
- Evaluating different estimation techniques and horizons is essential for optimizing HAR model performance.
Purpose of the Study:
- To compare the forecasting accuracy of Heterogeneous Autoregressive (HAR) models using various estimation techniques and horizons.
- To identify the optimal estimation method and forecasting horizon for HAR models.
- To assess the impact of exogenous variables and enhanced model specifications on forecasting accuracy.
Main Methods:
- Examined three HAR-type models with five estimation techniques and four forecasting horizons.
- Utilized 5-minute intraday data for the Standard & Poor's 500 (SPX) index and the VIX index as exogenous variables.
- Employed Quasi-Likelihood (QLIKE), Mean Absolute Error (MAE), and Mean Squared Error (MSE) for performance evaluation.
Main Results:
- The Entropy Loss Function consistently yielded the best Quasi-Likelihood (QLIKE) results across all horizons, particularly the weekly horizon.
- The Robust Linear Model proved to be a competitive alternative, showing strong performance in Mean Absolute Error (MAE) and Mean Squared Error (MSE).
- Incorporating Realized Quarticity (HARQ model) and the VIX index significantly improved overall model forecasting accuracy.
Conclusions:
- Both the Entropy Loss Function and the Robust Linear Model demonstrate significant forecasting accuracy for HAR models.
- The choice of estimation technique and forecasting horizon critically impacts HAR model performance.
- Enhancing HAR models with informative lags and exogenous variables like VIX leads to improved predictive power.
Related Concept Videos
Entropy Change in Reversible Processes
The statement can be further generalized to prove that entropy is a state function. Take a cyclic process between any two points on a p-V diagram.
Standard Entropy Change for a Reaction
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
Propagation of Uncertainty from Random Error
Propagation of Uncertainty from Systematic Error
Entropy and the Second Law of Thermodynamics
The relation between entropy and disorder can be illustrated with the example of the phase change of ice to water. In ice, the molecules are located at specific sites giving a solid state, whereas, in a liquid form, these molecules are much freer to move. The molecular arrangement has therefore become more randomized. Although the change in average...

