1.13k likes | 1.28k Views
A Plea for Adaptive Data Analysis An Introduction to HHT. Norden E. Huang Research Center for Adaptive Data Analysis National Central University.
E N D
A Plea for Adaptive Data AnalysisAn Introduction to HHT Norden E. Huang Research Center for Adaptive Data Analysis National Central University
Ever since the advance of computer, there is an explosion of data. The situation has changed from a thirsty for data to that of drinking from a fire hydrant.We are drowning in data, but thirsty for knowledge!
Henri Poincaré Science is built up of facts*, as a house is built of stones; but an accumulation of facts is no more a science than a heap of stones is a house. * Here facts are indeed data.
Scientific Activities Collecting, analyzing, synthesizing, and theorizing are the core of scientific activities. Theory without data to prove is just hypothesis. Therefore, data analysis is a key link in this continuous loop.
Data Analysis Data analysis is too important to be left to the mathematicians. Why?!
Mathematicians Absolute proofs Logic consistency Mathematical rigor Scientists/Engineers Agreement with observations Physical meaning Working Approximations Different Paradigms IMathematics vs. Science/Engineering
Mathematicians Idealized Spaces Perfect world in which everything is known Inconsistency in the different spaces and the real world Scientists/Engineers Real Space Real world in which knowledge is incomplete and limited Constancy in the real world within allowable approximation Different Paradigms IIMathematics vs. Science/Engineering
Rigor vs. Reality As far as the laws of mathematics refer to reality, they are not certain; and as far as they are certain, they do not refer to reality. Albert Einstein
Data Processing and Data Analysis • Processing [proces < L. Processus < pp of Procedere = Proceed: pro- forward + cedere, to go] : A particular method of doing something. • Data Processing >>>> Mathematically meaningful parameters • Analysis [Gr. ana, up, throughout + lysis, a loosing] : A separating of any whole into its parts, especially with an examination of the parts to find out their nature, proportion, function, interrelationship etc. • Data Analysis >>>> Physical understandings
Traditional Data Analysis All traditional ‘data analysis’ methods are either developed by or established according to mathematician’s rigorous rules. They are really ‘data processing’ methods. In pursue of mathematic rigor and certainty, however, we are forced to idealize, but also deviate from, the reality.
Traditional Data Analysis As a result, we are forced to live in a pseudo-real world, in which all processes are Linear and Stationary
削足適履 Trimming the foot to fit the shoe.
Available ‘Data Analysis’ Methodsfor Nonstationary (but Linear) time series • Spectrogram • Wavelet Analysis • Wigner-Ville Distributions • Empirical Orthogonal Functions aka Singular Spectral Analysis • Moving means • Successive differentiations
Available ‘Data Analysis’ Methodsfor Nonlinear (but Stationary and Deterministic) time series • Phase space method • Delay reconstruction and embedding • Poincaré surface of section • Self-similarity, attractor geometry & fractals • Nonlinear Prediction • Lyapunov Exponents for stability
Typical Apologia • Assuming the process is stationary …. • Assuming the process is locally stationary …. • As the nonlinearity is weak, we can use perturbation approach …. Though we can assume all we want, but the reality cannot be bent by the assumptions.
掩耳盜鈴 Stealing the bell with muffed ears
Motivations for alternatives: Problems for Traditional Methods • Physical processes are mostly nonstationary • Physical Processes are mostly nonlinear • Data from observations are invariably too short • Physical processes are mostly non-repeatable. Ensemble mean impossible, and temporal mean might not be meaningful for lack of stationarity and ergodicity. Traditional methods are inadequate.
The Job of a Scientist The job of a scientist is to listen carefully to nature, not to tell nature how to behave. Richard Feynman To listen is to use adaptive method and let the data sing, and not to force the data to fit preconceived modes.
The Traditional View of the Hilbert Transform for Data Analysis
The Empirical Mode Decomposition Method and Hilbert Spectral AnalysisSifting
Empirical Mode DecompositionSifting : to get one IMF component
The Stoppage Criteria The Cauchy type criterion: when SD is small than a pre-set value, where
Empirical Mode DecompositionSifting : to get all the IMF components
Definition of Frequency Given the period of a wave as T ; the frequency is defined as