580 likes | 631 Views
Numerical Analysis. MATLAB programming Numerical Methods I Numerical Methods II Marginal density estimation Expectation and maximization(EM) Annealed EM AEM for Clustering analysis Traveling salesman problem Numerical Methods III Independent component analysis Classification
E N D
Numerical Analysis • MATLAB programming • Numerical Methods I • Numerical Methods II • Marginal density estimation • Expectation and maximization(EM) • Annealed EM • AEM for Clustering analysis • Traveling salesman problem • Numerical Methods III • Independent component analysis • Classification • Function approximation • Density estimation Adavanced Numerical Computation
References • Numerical mathematics and computing, • fourth Edition, Cheney&Kincaid, 1999 • Lecture slides • ftp://134.208.26.61 user:ndhu passwd:ndhu port:4810 • G. Rechtenwald, Numerical methods with MATLAB: • Implementation and application. Adavanced Numerical Computation
Numerical Methods I • Numerical interpolation and approximation • Numerical integration and differentiation • Linear system and least square method • Approximation by spline functions Adavanced Numerical Computation
Interpolation Adavanced Numerical Computation
Function approximation Adavanced Numerical Computation
Function approximation Adavanced Numerical Computation
Initial Value Problem for ODEs Adavanced Numerical Computation
Numerical integration • Lower sum and upper sum • Trapezoid rule • Simpson rule Adavanced Numerical Computation
Linear system Ax=b Given A and b, find x Ex. Adavanced Numerical Computation
Approximation by spline functions • Quadratic spline • Cubic spline • Natural cubic spline • B-splines Adavanced Numerical Computation
Smoothing and the least square method Adavanced Numerical Computation
Numerical methods II • Expectation and maximization(EM) • Marginal density estimation • Annealed EM • Marginal density estimation(AEM) • AEM for Clustering analysis • Traveling salesman problem Adavanced Numerical Computation
Generator . . . Generator . . . Generator A generative model for Gaussian mixtures Multiplexer Adavanced Numerical Computation
Marginal Density Estimation Adavanced Numerical Computation
Clustering analysis Adavanced Numerical Computation
Clustering analysis Adavanced Numerical Computation
Density estimation- Gaussian Mixtures p 2 M Flip Coin … … … … Adavanced Numerical Computation
Generative models of natural images Adavanced Numerical Computation Figure 5
Generative models of natural images Adavanced Numerical Computation
Traveling salesman problems Adavanced Numerical Computation
Numerical Methods III • Independent component analysis • Linear ICA • Convolutive ICA • Classification • Data driven function approximation • Multivariate density estimation Adavanced Numerical Computation
Independent component analysis Adavanced Numerical Computation
Independent component analysis Observations Adavanced Numerical Computation
Independent component analysis Recovered sources Adavanced Numerical Computation
Blind source separation – fetal ECG BSS Adavanced Numerical Computation
sources mixed images AemICA JadeICA Adavanced Numerical Computation
Fz F3 F4 Cz C3 Pz Oz N1 N2 P2 P3 Adavanced Numerical Computation
Fz F3 F4 Cz C3 Pz Oz P2 N1 N2 P3 Figure 12 Adavanced Numerical Computation
Blind source separation by convolutive ICA music and speech Adavanced Numerical Computation
Convolutive mixtures Adavanced Numerical Computation
Recovered sources Adavanced Numerical Computation
Numerical methods III • Independent component analysis • Classification • Function approximation • Multivariate density estimation Adavanced Numerical Computation
Classification- Face detection Adavanced Numerical Computation
Classification- Face detection Adavanced Numerical Computation
Classification- Face detection Adavanced Numerical Computation
Classification- Face recognition Adavanced Numerical Computation
Classification – breast cancer diagnosis Breast Cancer Diagnosis FNA細胞樣本 Features: clump thickness uniformity of cell size uniformity of cell shape marginal adhesion single epithelial cell size bare nuclei bland chromatin normal nucleoli and mitoses A camera on a Microscope Benign Or Malignant Feature extractor Adavanced Numerical Computation
Function Approximation a. Adavanced Numerical Computation
Function Approximation b. Adavanced Numerical Computation
Function Approximation Adavanced Numerical Computation
Density estimation Adavanced Numerical Computation
Density estimation Adavanced Numerical Computation
Density estimation Adavanced Numerical Computation
a b d c Density estimation Adavanced Numerical Computation
a b d c Density estimation Adavanced Numerical Computation
Density estimation b a c d Adavanced Numerical Computation
Density estimation a b Adavanced Numerical Computation