Eddie McKenzie Statistics & Modelling Science University of Strathclyde Glasgow Scotland

1. Damped Trend Forecasting: You know it makes sense! Eddie McKenzie Statistics & Modelling Science University of Strathclyde Glasgow Scotland Everette S. Gardner Jr Bauer College of Business University of Houston Houston, Texas USA

2. A trend is a trend is a trend, But the question is, will it bend? Will it alter its course Through some unforeseen force And come to a premature end? Sir Alec Cairncross, in Economic Forecasting, 1969

3. Linear Trend Smoothing (Holt)

4. Linear Trend Smoothing (Holt)

7. Past Present Future

8. Past Present Future

9. Past Present Future

10. Exponential Smoothing Past Present Future

11. Exponential Smoothing Past Present Future

12. Exponential Smoothing Damped Trend Forecasting Past Present Future

15. Strong Linear Trend in Data   usual Linear Trend forecast Erratic/Weak Linear Trend   Trend levels off to constant No Linear Trend   Simple Exponential Smoothing

16. Demonstrated (1985-89) on a large database of time series that using the method on all non-seasonal series gave more accurate forecasts at longer horizons, but lost little, if any accuracy, even at short ones. Damping trend may seem – perhaps sensibly conservative – but arbitrary. However, works extremely well in practice…. …. two academic reviewer comments from large empirical studies… “… it is difficult to beat the damped trend when a single forecasting method is applied to a collection of time series.”(2001) Damped Trend can “reasonably claim to be a benchmark forecasting method for all others to beat.” (2008)

17. Reason for Empirical Success? Pragmatic View Projecting a Linear Trend indefinitely into the future is simply far too optimistic (pessimistic) in practice. Damped Trend is more conservative for longer-term, more reasonable, and so more successful, but ……

18. …….. leaves unanswered the question: How can we model what is happening in the observed time series that makes Damped Trend Forecasting a successful approach?

19. Modelling View: • Amongst models used in forecasting, can we find one • which has intuitive appeal and • for which Trend –Damping yields an optimal approach?

20. SSOE State Space Models Linear Trend model:

21. SSOE State Space Models Linear Trend model …. Reduced Form is an ARIMA(0,2,2)

22. Damped Linear Trend model: Reduced Form: ARIMA(1,1,2)

23. Strong Linear Trend in Data   usual Linear Trend forecast Erratic/Weak Linear Trend   Trend levels off to constant No Linear Trend   Simple Exponential Smoothing

24. Our Approach: use as a measure of the persistence of the linear trend, i.e. how long any particular linear trend persists, before changing slope …… Have RUNS of a specific slope with each run ending as the slope revision equation RESTARTS anew.

25. New slope revision equation form where are i.i.d. Binary r.v.s with

26. A Random Coefficient State Space Model for Linear Trend

27. Reduced version is a Random Coefficient ARIMA(1,1,2)

28. with probability : with probability :

29. Has the same correlation structure as the standard ARIMA(1,1,2) …and hence same MMSE forecasts … and so Damped Trend Smoothing offers an optimal approach

30. Optimal for a wider class of models than originally realized, including ones allowing gradient to change not only smoothly but also suddenly. Argue that this is more likely in practice than smooth change, and so Damped Trend Smoothing should be a first approach. (rather than just a reasonable approximation) Another – but clearly related – possibility is that the approach can yield forecasts which are optimal for so many different processes that every possibility is covered. To explore both ideas, used the method on the M3 Competition database of 3003 time series, and noted which implied models were identified.

32. Series requiring Damping: 84% 70%

33. Series with some kind of Drift or Smoothed Trend term 98.9% 99.4%

35. 1. SES with Drift: 2. SES with Damped Drift: 3. Random Walk with Drift & Damped Drift: as 1 & 2 above with 4. Modified Exponential Trend:

36. 1. SES with Drift: Both correspond to random gradient coefficient models in which the drift term or slope satisfies 2. SES with Damped Drift: .. As before, but with no error. Thus, slope is subject to changes of constant values at random times 3. Random Walk with Drift & Damped Drift: as 1 & 2 above with 4. Modified Exponential Trend:

37. Additive Seasonality (period: n)

38. with probability : with probability :

39. State Space Models: Non-constant variance models

40. Random Coefficient version:

41. with probability : where with probability : where