910 likes | 1.12k Views
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series. Norden E. Huang Research Center for Adaptive Data Analysis National Central University, Taiwan. Satellite Altimeter Data : Greenland. Two Sets of Data. IPCC Global Mean Temperature Trend.
E N D
On the Trend, Detrend and the Variability of Nonlinear and Nonstationary Time Series Norden E. Huang Research Center for Adaptive Data Analysis National Central University, Taiwan
The State-of-the-Arts“One economist’s trend is another economist’s cycle” Engle, R. F. and Granger, C. W. J. 1991 Long-run Economic Relationships. Cambridge University Press. • Simple trend – straight line • Stochastic trend – straight line for each quarter
PhilosophicalProblem 名不正則言不順 言不順則事不成 ——孔夫子
OnDefinition Without a proper definition, logic discourse would be impossible.Without logic discourse, nothing can be accomplished.Confucius
Definition of the Trend Within the given data span, the trend is an intrinsically determined monotonic function, or a function in which there can be at most one extremum. The trend should be determined by the same mechanisms that generate the data; it should be an intrinsic and local property. Being intrinsic, the method for defining the trend has to be adaptive. The results should be intrinsic (objective); all traditional trend determination methods give extrinsic (subjective) results. Being local, it has to associate with a local length scale, and be valid only within that length span as a part of a full wave cycle.
Definition of Detrend and Variability Within the given data span, detrend is an operation to remove the trend. Within the given data span, the Variability is the residue of the data after the removal of the trend. As the trend should be intrinsic and local properties of the data; Detrend and Variability are also local properties. All traditional trend determination methods are extrinsic and/or subjective.
The Need for HHT HHT is an adaptive (local, intrinsic, and objective) method to find the intrinsic local properties of the given data set, therefore, it is ideal for defining the trend and variability.
Global Temperature Anomaly Annual Data from 1856 to 2003
How are GSTA data derived? Noise Reduction Using Global Surface Temperature Anomaly data 1856 to 2003
Observations • Annual data is actually the mean of 12:1 down sample set of the original monthly data. • In spite of the removal of climatologic mean, there still is a seasonal peak (1 cycle / year). • Seasonal Variation and Variance are somewhat irregular. • Data contain no information beyond yearly frequency, for higher frequency part of the Fourier spectrum is essentially flat. • Decide to filtered the Data with HHT before down sample.
Need a Filter to Remove Alias • Traditional Fourier filter is inadequate: • Removal of Harmonics will distort the fundaments • Noise spikes are local in time; signals local in time have broad spectral band • HHT is an adaptive filter working in time space rather than frequency space.
GSTA : Annual Data Jones and HHT SmoothedFor the Difference : Mean = - 0.082; STD = 0.01974
GSTA : Annual Variance Jones and HHT SmoothedMean HHT = 0.0750; Jones = 0.1158
Summary • Global Surface Temperature Anomaly should not be derived from simple annual average, because there are noises in the data. • Noise with period shorter than one year could have caused alias in down sampling. • Smoothing the data by removing any data with a period shorter than 8 months should improved the annual mean.
Financial Data : NasDaqSC October 11, 1984 – December 29, 2000 October 12, 2004