Time Series Analysis

Chapter 15 · Course Review and Exam Preparation

The slide of the lecture is on the left, the same figure or table on the right, computed in the browser from the same data. The ▶ button moves the parameter step by step; the “Worked example” boxes redo the solutions of the exam problems with the numbers of the chapter.

Box–Jenkins from start to finish: Romanian inflation · The exam

Box–Jenkins from start to finish: Romanian inflation

Step 1: the data

Slide 39: Step 1: the data
Slide 39
    Question for the room ▶ moves the end of the sample from August 2010 to August 2026. How does the mean monthly inflation change?
    Answer

    It falls from 0.52% (2005–2010) to 0.31% (to August 2020), then rises to 0.39% over the whole sample: the 2021–2023 inflation wave and the 2025 tax shock raise the mean. The minimum of annual inflation, −3.0% in May 2016, has the June 2015 VAT cut on food inside its 12-month window; the maximum, 13.6%, is in November 2022.

    Interpreting the data

    Slide 40: Interpreting the data
    Slide 40
      Question for the room ▶ moves the start of the sample up to 2020. Does mean June inflation stay negative?
      Answer

      No: since 2020 June averages +0.28%, and January remains the highest month (0.94%). The seasonal pattern (January high, June low) survives, but its level rises with the general inflation of 2021–2023; this is why the model works with Δ12, which removes both the level and the fixed seasonality.

      Step 2: unit-root and stationarity tests

      Slide 41: Step 2: unit-root and stationarity tests
      Slide 41
        Question for the room ▶ steps through the samples ending in December 2012, …, 2025. What verdict does annual inflation Δ12 ln P get for the 2013–2021 samples?
        Answer

        Unit root: ADF does not reject (p between 0.66 and 0.97) and KPSS rejects (η between 0.59 and 1.48, above 0.463). The inconclusive result of the lecture appears only after 2022, when the inflation wave adds variation. In the same years Δ ln P gets “conflicting”: both tests reject, because the seasonality and the level shifts of monthly inflation violate the assumptions of both tests.

        Step 3: identification from the correlogram of zₜ

        Slide 42: Step 3: identification from the correlogram of zₜ
        Slide 42
          Question for the room ▶ switches to Δ ln P (no seasonal difference). What does the ACF show at lags 12, 24 and 36?
          Answer

          0.25, 0.22 and 0.18, all above the ±0.12 band and decaying slowly: the seasonal pattern has not been removed, so Δ12 is needed. For Δ12 ln P the ACF starts at 0.98 and decays very slowly (a near unit root); only z = ΔΔ12 ln P has a single large seasonal value, −0.45 at lag 12.

          Interpreting the correlogram

          Slide 43: Interpreting the correlogram
          Slide 43
            Question for the room ▶ passes through φ = 0. What is the theoretical ρ12 then, for Θ = −0.867?
            Answer

            −0.49 = Θ/(1 + Θ2) = −0.867/1.752. A seasonal MA(1) has a single nonzero seasonal autocorrelation, at lag 12, and its size cannot exceed 0.5 in absolute value; with φ = 0 the satellites at 11 and 13 vanish. With φ = 0.416 they are about φ · ρ12, and in the sample ρ̂11 = −0.12 and ρ̂13 = −0.15, close to the product ρ̂1ρ̂12 = −0.15.

            Step 4: estimating the candidates

            Slide 44: Step 4: estimating the candidates
            Slide 44
              Question for the room ▶ moves the penalty c from 2 to 9. Which model has the lowest criterion at c = 2 (AIC without the correction)?
              Answer

              (2,1,1)(0,1,1)12, the chosen model itself. With c = ln 223 = 5.41 (BIC) the winner is (1,1,1)(0,1,1)12, which has one parameter less but fails the Ljung–Box test at lag 12 (p = 0.029); from c ≈ 5 upward it stays first. The chosen model does not change for any c in the chart, because it is the best of the models that pass the checks.

              Step 4: the chosen model

              Slide 45: Step 4: the chosen model
              Slide 45
                Question for the room ▶ steps through the five models of the table. Which one has its smallest AR root closest to 1?
                Answer

                (2,1,1)(0,1,1)12, with modulus 1.034 (inverse 0.967), followed by (1,1,2)(0,1,1)12 with 1.035. The identified model has a single AR root, 2.40: an AR(1) with φ = 0.42 cannot reproduce the persistence of inflation. The seasonal MA roots all have modulus close to 1 (1.006): Θ1 ≈ −1 nearly cancels Δ12.

                Step 5: checking the residuals

                Slide 46: Step 5: checking the residuals
                Slide 46
                  Question for the room ▶ steps through the five models of the table of step 4. For which of them does the kurtosis of the residuals fall below 5?
                  Answer

                  None: the kurtosis stays between 9.5 and 10.0 and Jarque–Bera between 390 and 454. Extra AR and MA terms remove autocorrelation, not outliers: the residuals of June 2015 (−6.1σ) and July 2010 (5.3σ) come from VAT changes that no univariate model can foresee.

                  Interpreting the residual checks

                  Slide 47: Interpreting the residual checks
                  Slide 47
                    Question for the room ▶ moves m from 6 to 36. Does the chosen model (2,1,1)(0,1,1)12 pass the Ljung–Box test at 5% for every m?
                    Answer

                    No: p = 0.025 at m = 7 and p = 0.048 at m = 8; at every other lag, 12 and 24 (those of the lecture) included, p > 0.05. The identified model fails at every m from 6 to 36. Tests at several lags are not independent: the choice of m flips a borderline verdict, which is why the lecture reports two lags fixed in advance.

                    Step 6: forecasts

                    Slide 48: Step 6: forecasts
                    Slide 48
                      Question for the room ▶ moves the forecast origin from August 2025 to August 2026. With the origin in August 2025, what does the model forecast for annual inflation in August 2026 (realised: 6.1%)?
                      Answer

                      9.7%, with the 95% interval [3.9, 15.5], which contains the realised value. The model treats part of the July–August 2025 jumps as persistent (AR root 0.967) and cannot know they were one-off tax decisions; over the later origins the 12-month forecast comes down, with ups and downs, to 6.3% from August 2026.

                      Interpreting the forecasts

                      Slide 49: Interpreting the forecasts
                      Slide 49
                        Question for the room ▶ lengthens the test sample from 6 to 24 months. Does the Diebold–Mariano test reject equal accuracy against the seasonal naive for any length?
                        Answer

                        No: the smallest p is 0.174, at 24 months. With 11 months the statistic even turns positive (0.10), because the large misses of July–August 2025 fall on SARIMA. A smaller RMSE is not a significant difference: on a short sample the variance of dt is large.

                        The exam

                        Problem 1: solution

                        Slide 56: Problem 1: solution
                        Slide 56

                        Worked example

                        \[\begin{gathered}Y_t = 10 + 0.5\,t + u_t,\quad u_t = \phi u_{t-1} + \varepsilon_t\\ \hat Y_{T+h} = 10 + 0.5\,(T+h) + \phi^h u_T,\quad \mathrm{Var}(e_{T+h}) = \frac{1-\phi^{2h}}{1-\phi^2}\end{gathered}\]
                            Question for the room ▶ moves φ up to 0.95. What is ρΔY(1) for φ = 0.95?
                            Answer

                            −0.025 = −(1 − φ)/2. Differencing a trend-stationary series gives an ARMA(1,1) with θ = −1; for φ close to 1 the AR root and the MA root nearly cancel and the ACF of ΔY looks like white noise, although ΔY stays non-invertible. With φ = 0 the correlation is −0.5, the value of an MA(1) with θ = −1.

                            Problem 2: solution

                            Slide 58: Problem 2: solution
                            Slide 58

                            Worked example

                            \[\Delta y_t = c + bt + \gamma y_{t-1} + \sum_j \delta_j \Delta y_{t-j} + \varepsilon_t,\quad H_0:\ \gamma = 0;\qquad Q(m) = T(T+2)\sum_{k=1}^{m}\frac{\hat\rho_k^2}{T-k}\]
                                Question for the room ▶ shortens the sample to 2019Q4 (no pandemic). Does growth pass the Ljung–Box Q(8) test?
                                Answer

                                Yes: Q(8) = 4.18, p = 0.841, and the drift is 1.00% a quarter (σ̂ = 2.49). Over the full sample, with 2020 included, Q(8) = 7.28 (p = 0.506) and the drift 0.81%: the 2020Q2 fall lowers the mean but creates no autocorrelation. The ADF test for the level is still not rejected (−2.08 in 2019Q4).

                                Problem 3: solution

                                Slide 60: Problem 3: solution
                                Slide 60

                                Worked example

                                \[z_t = \phi z_{t-1} + \Phi z_{t-12} - \phi\Phi z_{t-13} + \varepsilon_t,\qquad \Delta_{12}\ln P_{T+1} = \Delta_{12}\ln P_T + \hat z_{T+1}\]
                                    Question for the room ▶ moves the origin to August 2025 (the forecast for September 2025, right after the VAT jump). How does the hand forecast compare with the realised value?
                                    Answer

                                    The forecast is z = 0.753 and annual inflation 8.93%; the realised values are z = 0.090 and 8.26%. The term φzT carries the August jump into September, although the jump was a one-off decision. With the origin in July 2026 the forecast for August 2026 is 6.83%, against 6.09% realised: the exit of the jump from the 12-month window is underestimated, because |Φ̂| = 0.49 < 1.

                                    Problem 4: solution

                                    Slide 62: Problem 4: solution
                                    Slide 62

                                    Worked example

                                    \[\frac{\partial i}{\partial \pi} = \frac{b_{\pi,1} + b_{\pi,2}}{1 - b_{i,1} - b_{i,2}},\qquad F = \frac{(RSS_R - RSS_U)/p}{RSS_U/(T - Kp - 1)}\]
                                        Question for the room ▶ steps through the samples ending in 2015Q4, …, 2026Q2. How does the long-run effect of inflation on ROBOR change?
                                        Answer

                                        Up to 2022Q4 it stays between 1.06 and 1.32 (1.27 in 2019Q4), then falls to 0.91 in 2023Q4 and 0.90 in 2026Q2. The denominator 1 − bi,1 − bi,2 stays between 0.03 and 0.09, so small changes in the coefficients move the ratio a lot. The Granger test for g → i rejects on every sample (p ≤ 0.008).

                                        Problem 5: solution

                                        Slide 64: Problem 5: solution
                                        Slide 64

                                        Worked example

                                        \[\Delta \mathbf{y}_t = \boldsymbol\alpha\,\boldsymbol\beta^\top \mathbf{y}_{t-1} + \dots,\qquad \mathbf{ec}_t \approx (\mathbf{I} + \boldsymbol\beta^\top\boldsymbol\alpha)\,\mathbf{ec}_{t-1},\qquad h_{1/2} = \frac{\ln 0.5}{\ln|\lambda|}\]
                                            Question for the room ▶ raises the multiplier of α from 0.25 to 2. What does the slow half-life (22.1 months in the lecture) become with α doubled?
                                            Answer

                                            10.9 months, about half: for eigenvalues close to 1, ln λ ≈ −(1 − λ), and 1 − λ is proportional to α. The fast component falls from 9.0 to 4.3 months. With α divided by 4 the half-lives are 89.6 and 37.2 months.

                                            Problem 6: solution

                                            Slide 66: Problem 6: solution
                                            Slide 66

                                            Worked example

                                            \[\begin{gathered}\sigma^2_{t+1} = \omega + \alpha\varepsilon_t^2 + \beta\sigma_t^2,\qquad \bar\sigma^2 = \frac{\omega}{1-\alpha-\beta}\\ \mathrm{VaR}_{1\%} = -\left(\mu + \sigma_{t+1}\, t_\nu^{-1}(0.01)\sqrt{(\nu-2)/\nu}\right)\end{gathered}\]
                                                Question for the room Set εt = +3 instead of −3. What is σ2t+1?
                                                Answer

                                                Still 2.5685: GARCH(1,1) depends on εt2, so a 3% rise and a 3% fall have the same effect. The leverage effect needs an asymmetric model (GJR or EGARCH, Chapter 5). With εt = 0, σ2t+1 = 0.844, below today’s variance.

                                                Problem 7: solution

                                                Slide 68: Problem 7: solution
                                                Slide 68

                                                Worked example

                                                \[\begin{gathered}\mathrm{RMSE} = \sqrt{\tfrac1n\sum e_t^2},\quad \mathrm{MASE} = \frac{\mathrm{MAE}}{\mathrm{MAE}_{\text{in}}}\\ d_t = e_{A,t}^2 - e_{B,t}^2,\quad DM = \frac{\bar d}{s_d/\sqrt n}\end{gathered}\]
                                                    Question for the room ▶ multiplies the errors of the seasonal naive method by a factor from 0.5 to 2. From which factor does the DM test reject equal accuracy at 5%?
                                                    Answer

                                                    From about 1.35: DM = −2.33 at 1.2 and −2.63 at 1.4, against the critical value 2.571 with 5 degrees of freedom. With six months even a method with 40% larger errors is barely distinguishable; a MASE below 1 is not proof.

                                                    Problem 8: solution

                                                    Slide 70: Problem 8: solution
                                                    Slide 70

                                                    Worked example

                                                    \[\begin{gathered}K_t = \frac{P_t}{P_t + \sigma^2_\varepsilon},\quad \frac{\bar P}{\sigma^2_\varepsilon} = \frac{q + \sqrt{q^2 + 4q}}{2}\\ E(D_i) = \frac{1}{1 - p_{ii}},\quad \pi_1 = \frac{1 - p_{22}}{2 - p_{11} - p_{22}},\quad H = d + \tfrac12\end{gathered}\]
                                                        Question for the room ▶ moves ση2 up to 4 (q = 1). What is the steady-state gain?
                                                        Answer

                                                        0.618 = (1 + √5)/2 / (1 + (1 + √5)/2). The more the level moves relative to the noise, the more the filter trusts the new observation. The first step stays Kt = 2/6 = 0.333, because it depends only on Pt = 2 and σε2 = 4; the gain then converges to the steady state in a few steps.

                                                        The Romanian HICP (Eurostat prc_hicp_minr, 2015 = 100) is read with the chapter’s loader on 4 November 2026 and cut at August 2026, the last month of the lecture; the January 2005 – August 2026 values have not been revised and reproduce the numbers of the lecture exactly. The estimates of the 36 SARIMA models, their residuals and the forecasts come from the chapter’s code (statsmodels SARIMAX). Problem 2 uses Romanian real GDP in the version of the lecture (Chapter 3, read from the chapter’s vector chart because Eurostat has revised the series), Problem 4 the GDP growth, inflation and ROBOR 3M of the VAR of Chapter 6, Problem 5 the US Treasury yields (FRED, to September 2026), Problem 6 the GARCH(1,1)-t estimates of the BET from Chapter 5. The browser computes the correlograms, the Ljung–Box and Jarque–Bera tests, the accuracy measures, the Diebold–Mariano test, the OLS regressions of Problem 4 and the hand computations. Variants that do not appear in the lecture (other sample ends, other forecast origins, other penalties of the criterion, other lags, other parameters of the problems) are extra runs of the chapter’s code on the same data; the charts of “Interpreting the data”, “Step 2”, “Interpreting the correlogram”, “Step 4”, “Interpreting the residual checks”, “Interpreting the forecasts” and of the problem solutions are extra charts for slides that give only numbers.