Comparative Evaluation of VaR Models: Historical Simulation, GARCH-Based Monte Carlo, and Filtered Historical Simulation
Tian Xin · 2025
Read Comparative Evaluation of VaR Models: Historical Simulation, GARCH-Based Monte Carlo, and Filtered Historical Simulation by Tian Xin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-05646.txt.
Introduction
Xin Tian compares three ways of estimating how much a portfolio can lose on a bad day, in a paper from 2025. The head byline gives the name in this order, while the catalog reverses it. Daily five percent loss limits were computed by replaying history, by a volatility model with a bell curve, and by a hybrid that filters history through the volatility model.
The first two methods breached their limits far too often, which shows poor calibration. The hybrid matched its promised breach rate and behaved well on charts. Five day tests showed the bell curve version understates tail risk, while the hybrid stays prudently conservative. The author recommends the hybrid for short term risk work.
Catalog record
| CREATOR | Tian Xin |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-05646
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparative Evaluation of VaR Models: Historical Simulation, GARCH-Based Monte Carlo, and Filtered Historical Simulation Tian Xin Abstract This report presents a comprehensive evaluation of three Value-at-Risk (VaR) modeling approaches—Historical Simulation (HS), GARCH with Normal approximation (GARCH-N), and GARCH with Filtered Historical Simulation (FHS)—using both in-sample and multi-day forecasting frameworks… We then compute daily 5% VaR estimates using each method and assess their accuracy via empirical breach frequencies and visual breach indicators. Our findings reveal severe miscalibration in the HS and GARCH-N models, with empirical breach rates far exceeding theoretical levels at both 5% and 1% confidence thresholds. In contrast, the FHS method consistently aligns with theoretical expectations and exhibits desirable statistical and visual behavior. Further, we simulate 5-day cumulative returns under both GARCH-N and GARCH-FHS frameworks to compute multi-period VaR and Expected Shortfall (ES). Results show that GARCH-N underestimates tail risk due to its reliance on the Gaussian assumption, whereas GARCH-FHS provides more robust and conservative tail estimates. Overall, the study demonstrates that the GARCH + FHS model offers superior performance in capturing fat-tailed risks and provides more reliable short-term risk forecasts. We recommend the FHS method for practical applications in risk management, particularly in volatile market environments and high-confidence settings. \journalname Managing Financial Risk \professor Supervised by Professor Yinan Su \institution Carey Business School \theday Spring 2025 \leadauthor Tian Xin \course BU.230.730.52 keywords History Simulation, GARCH + Monte Carlo Simulation, GARCH + Filtered Historical Simulation \tauabstract Introduction Value-at-Risk (VaR) has become one of the most widely used quantitative tools in modern financial risk management. By summarizing the maximum expected loss over a specified time horizon at a given confidence level, VaR provides a standardized measure of downside risk that is essential for regulatory compliance, capital allocation, and internal control. However, the accuracy and reliability of VaR estimates are highly dependent on the underlying modeling assumptions, including distributional assumptions, volatility dynamics, and simulation techniques. This report evaluates and compares three prominent VaR estimation methods: Historical Simulation (HS), GARCH with Normal approximation (GARCH-N), and GARCH with Filtered Historical Simulation (FHS). Each method represents a distinct philosophy of risk modeling—ranging from non-parametric empirical estimation to parametric and semi-parametric approaches that account for volatility clustering and fat tails. The analysis is structured around two key objectives. First, we assess the in-sample performance of each method by computing one-day ahead VaR forecasts at both 5% and 1% confidence levels and evaluating their breach frequencies and distributional consistency. Second, we extend the analysis to a five-day forecasting horizon using Monte Carlo simulation under both GARCH-N and FHS frameworks, comparing the cumulative VaR and Expected Shortfall (ES) over time. Through empirical analysis, visualization, and simulation, we aim to identify which model provides the most accurate and stable risk estimates—particularly under stress conditions. Our findings have practical implications for risk managers seeking robust tools for monitoring and managing extreme losses in volatile markets. QQ-Plot of Historical Returns vs. Normal Distribution To evaluate whether the distribution of historical returns follows a normal distribution, we plot the QQ-plot comparing the empirical quantiles of full-sample returns with those from a normal distribution having the same mean and standard deviation. Figure 1 : QQ-Plot: Historical Returns vs. Normal Distribution (same mean and std) Conclusion The QQ-plot clearly indicates that the unconditional distribution of returns does not follow a normal distribution . Specifically, we observe the following characteristics: • Fat left tail : On the left side, the empirical quantiles fall below the normal quantiles, suggesting that large negative returns are more extreme than predicted by the normal model. • Fat right tail : On the right side, the empirical quantiles rise above the normal quantiles, indicating more extreme positive returns than expected under normality. • Leptokurtosis (high kurtosis) : While the central part of the distribution aligns relatively well with the 45-degree line, both tails exhibit significant deviations, implying a sharper peak and heavier tails than a normal distribution. These observations are consistent with common characteristics of financial return series, which typically exhibit excess kurtosis and heavy tails. Therefore, assuming normality for the unconditional return distribution may lead to underestimation of tail risk. QQ-Plot of Standardized Residuals vs. Standard Normal To assess the validity of the conditional normality assumption in the GARCH model, we construct a QQ-plot comparing the standardized residuals z_{t} with the standard normal distribution. The residuals are filtered from returns using the GARCH volatility estimate via the relation R_{t}=\sigma_{t}z_{t} . Figure 2 : QQ-Plot: GARCH Standardized Residuals z_{t} vs. Standard Normal Conclusion Based on the QQ-plot, we conclude that the conditional distribution of returns still deviates from normality , although it is closer than the unconditional distribution. Specifically: • Fat left tail : The lower quantiles of z_{t} are more extreme than those predicted by the standard normal distribution. This indicates a higher likelihood of large negative returns, even after GARCH filtering. • Fat right tail : The upper quantiles also deviate positively from the theoretical quantiles, although less severely than the left tail. • Heavier tails overall : Both tails are more dispersed compared to the standard normal distribution, which suggests that even under the GARCH framework, the assumption of conditional normality does not fully capture extreme market movements. While GARCH filtering removes some volatility clustering and improves normality, the standardized residuals still exhibit excess kurtosis, making the conditional normality assumption questionable for tail risk estimation. In-Sample One-Day VaR Estimation In this question, we estimate one-day-ahead 5% Value-at-Risk (VaR 0.05 ) for each day in the sample using three methods: 1. Historical Simulation (HS) : For each day t , we take the empirical 5% quantile of raw returns over the past m=200 days: \text{VaR}_{t}^{\text{HS}}=\text{Quantile}_{0.05}(R_{t-m},\ldots,R_{t-1}) 2. GARCH + Normal Approximation (GARCH-N) : Assuming that standardized residuals z_{t} follow \mathcal{N}(0,1) and returns are conditionally normal: \text{VaR}_{t}^{\text{GARCH-N}}=\sigma_{t}\cdot\Phi^{-1}(0.05) where \sigma_{t} is the conditional volatility estimated from the GARCH(1,1) model. 3. Filtered Historical Simulation (FHS) : Instead of assuming z_{t} is standard normal, we use the empirical distribution of standardized residuals in the past m=200 days: \text{VaR}_{t}^{\text{FHS}}=\sigma_{t}\cdot\text{Quantile}_{0.05}(z_{t-m},\ldots,z_{t-1}) Implementation Notes • The first 200 observations are omitted since VaR estimates require a rolling window of size m=200 . • All methods are evaluated over the same time window for fair comparison. • The quantiles are computed precisely using empirical sorting rather than interpolation or simulated distributions. Data Representation A snapshot of the estimated daily VaRs is presented in Table 1. Date & Return & VaR (HS) & VaR (GARCH-N) & VaR (FHS) 2005-11-01 & 0.002992 & -0.011347 & -0.000167 & -0.000155 2005-11-02 & 0.010403 & -0.011347 & -0.000148 & -0.000138 2005-11-03 & 0.004262 & -0.011347 & -0.000152 & -0.000143 2005-11-04 & -0.001309 & -0.011347 & -0.000137 & -0.000129 2005-11-07 & 0.000982 & -0.011347 & -0.000121 & -0.000115 2005-11-08 & 0.000000 & -0.011347 & -0.000107 & -0.000102 2005-11-09 & 0.001308 & -0.011347 & -0.000097 & -0.000091 2005-11-10 & 0.007732 & -0.011347 & -0.000087 & -0.000082 2005-11-11 & 0.003400 & -0.011347 & -0.000090 & -0.000086 2005-11-14 & -0.000566 & -0.011347 & -0.000084 & -0.000080 2025-04-07 & -0.001783 & -0.017955 & -0.001355 & -0.001697 2025-04-08 & -0.015787 & -0.017955 & -0.001163 & -0.001450 2025-04-09 & 0.099863 & -0.017955 & -0.001017 & -0.001304 2025-04-10 & -0.044808 & -0.017955 & -0.002919 & -0.003728 2025-04-11 & 0.017686 &