High performance computing in data and image processing

1. High performance computing in data and image processing A.A. Lukianitsa1,2, A.G. Shishkin1,2, F.S. Zaitsev1,2 1Fusion Advanced Research Group Ltd., Slovakia. 2Moscow State University, Russia. 1www.mental.sk 7th Workshop on Fusion Data Processing Validation and Analysis Invitation. Frascati 2012

2. Contents • Motivation. • Previous experience in fusion data mining. • High performance computing (HPC). • Examples of HPC applications. • “Virtual Tokamak” technology. • Summary.

3. 1. Motivation • Huge amounts of collected and stored data from various sources: • Large physical experiments. • Video surveillance. • DNA sequencing. • New challenges in various scientific areas: • Real-time thermonuclear pulses control. • Genomic sequence analysis and gene-finding. • Real-time video analysis and indexing. • New computational algorithms. • Internet transmission speeds and usage keep growing. Cloud computing. • Urgent need for high performance computing.

4. 2. Previous experience in fusion data mining L,H-mode classification with SVM for the Global confinement database 104 pulses [Plas.Phys.Contr. Fus. 50(2008)065013]. Linear separating hyperplane was found Forecast accuracy - 92.66%. Deep H-mode is predicted for ITER. Power loss threshold is more optimistic for ITER ~0 (was ~40) MW. Allows checking L or H-mode for a particular set of 8 parameters, including prediction and evaluation how deep is the set in a mode.

5. [32 EPS Conf. on Plasma Phys. 2005, P-1.092] Code VIP (Video Image Processing). Plasma boundary reconstruction in (R,Z,η). Dynamic programming algorithm.

6. Actual plasma boundary is quite different from the image and can be different from the EFIT reconstruction. Code VIP was installed in MAST for regular use.

7. 3D processing: plasma boundary reconstruction.

8. 5 5 5 6 2 6 2 2 4 6 3 4 4 3 3 1 1 1 5 6 2 4 3 1 Detection and tracking of snow flakes in JET plasma video. [Frontiers in Diagnostic Technologies.1st Int. Conf. Frascati 2009] Complicated algorithm: camera image stabilizing, image intensity equa- lizing, background modeling, foreground particles separation, snowflakes tracking. Snowflakes tracking over the time Frame=78 Frame=79 Frame=80 Trajectories

9. Demo of snow flakes detecting and tracking. The moment of appearance, trajectory, size, shape and color can give understanding what is happening.

10. Code FIRe (Fluorescence Intensity Reconstruction) - reconstructingdistribution of the source of light using high resolution photo or video images. [1st Korean-Russian Workshop on Data Mining. 2007, p. 17-25] Tikhonov regularization algorithm. Treating several cameras. Removing the lens distortions. Options for given number of mirror or diffusive reflections from surfaces. Ray tracing. Description of each particular surface using triangular grid. Reconstruction for MAST plasmas One camera in the equatorial plane

11. Processing of magnetic diagnostics data using Hidden Markov Models(HMMs). Integrated data analyses. [8th Int. FLINS Conference "Computational Intelligence in Decision and Control“. Madrid 2008, p. 43-48.] Well suited, since magnetic frequencies are similar to the speech ones. HMMs allow compression (from giga to kilo bytes) of time dependent data of different length, without substantial loss of information, to a standardized form, which can be used for different purposes, e.g. pattern recognition. • Possible applications (almost all plasma processes change magnetic field): • Navigation in the magnetic databases: finding similar or distant patterns. • Instabilities recognition and prediction. Disruption prediction. • Recognition of L, H-transition during a hybrid scenario pulse. • Regular oscillations recognition. Determination of symmetry or rotation characteristics in poloidal or toroidal angles, harmonics numbers, unstable modes. • Integrated analyses of data from different diagnostics (~100 in JET). Correlating with experimental (X-ray, optical, neutral, neutron, currents in coils, etc.) and/or numerical (safety factor, current density, type of instability, plasma shape, temperature and density profiles, etc).

12. Transformation of magnetic oscillations to the sound frequencies.

13. 3. HP computing CPU vs. GPU: • CPU • Fast caches. • Branching adaptability. • High performance. • GPU • Multiple ALUs (Arithmetic Logic Units). • Fast onboard memory. • High throughput on parallel tasks/ • Executes program on each fragment/vertex. • Easily scalable. • CPUs are good for task parallelism. • GPUs are good for data parallelism.

14. FARG experience with CUDA for commercial applications: detecting & tracking of moving or left objects, monitoring car parking spaces, face detection & recognition, smoke & fire detection in videos, noise auto suppression, genetic information transfer, art authentication, emotion recognition by speech, biomedical signal analyses, etc. Acceleration log10S

15. 4. Examples of HPC applications Demo of hyperplane construction with SVM. Accelertion ~103.

16. Real-time НPC optical flow processing Key Features • Move to real-time Optical Flow on high video resolution and high frame rate. • Edge-preserving post processing algorithm to enhance quality. • More accurate occlusion estimation. • Scalable, modular, versatile architecture. • Low system’s resources consumption.

17. Real-time НPC optical flow processing GPU/CPU speed up, times Frame resolution

18. Real-time НPC optical flow processing: the original video, background, blobs (compact moving objects), foreground (isolated blobs), blobs boundaries.

19. 5. Virtual Tokamak • Modeling plasma pulses and diagnostics within the universal toolbox “Virtual Tokamak” framework. • Singling out the most advanced and adequate approaches and algorithms in direct and inverse problems in fusion. Their modification and standardization. • Allowing remote usage of the software by a usual Web-browser. • Distributed computations, cloud and GRID-like technologies. • Integrated data analyses. Diagnostics benchmarking and co-ordination. Design support. Pilot URL: leader.ic.msu.su/~fusion

20. Demo of the “Vertual Tokamak” GUI.

21. 6. Summary • Accurate and robust data and image processing codes are described with HPC advancement of the algorithms 10-1000. • HPC algorithms can allow real time plasma data analyses, reconstruction, modeling and 3D processing as in commercial applications. • Possible application in advanced real-time feed-back plasma shape and position control and instabilities suppression. • Advancement of the plasma and chamber state alarm systems. • A reasonable direction of diagnostics advancements is application of FARG’s commercial HPC developments as modules in the existing software, e.g. used at JET. • CUDA HPC has high potential in numerical codes: e-nets, Monte-Carlo.