Report from A+M Data Centre, RRC “Kurchatov Institute”

Report from A+M Data Centre,RRC “Kurchatov Institute” Yu.V.Martynenko 19th Meeting of the Atomic and Molecular Data Centers and ALADDIN Network Vienna, 03-05 October 2007

The main activities on A+M/PSI DATA: • 1. The new A+M Data generation. (Experiment, theory, codes). • 2. Computer code for tokamak plasma processes • 3. Data Acquisition System + (DAS+). • This software is developed for operation with experimental data of various devices of controlled nuclear fusion (storage, transmission, processing and results representation). The software allows to create Data warehouse for data and gives possibility for multi-devices fusion researches. • . • 3. Data base.

DATA GENERATION • A+M • Atomic particles cross section measurement (split beam methods). • Theory of atomic particles interaction. • Analytic models and codes for atomic kinetic and radiations. • PSI • Surface erosion and modification • ion beams, plasma exposition • theory • 2. H retention and permeability

COMPUTER CODES FOR TOKAMAK • PLASMA PROCESSES • The integration of already existing codes • for comprehensive SOL description: • Plasma dynamic, convection transport(Shurygin / Pastukhov) • Universal Numerical Code for • atomic kinetics and radiation (V. Lisitsa) • Material response on plasma affect (Martynenko, Moskovkin) • (DB sputtering yields and reflection coefficients)

Data Acquisition System + • THE UNIFICATION OF ACCESS TO EXPERIMENTAL DATA OF FUSION DEVICES:Т-10, GTB, PN-3, S300, L-2M, Tuman, Globus, PS-3, CastorNFI RRC “Kurchatov Institute”. http://t10.fusion.ru,misha@fusion.ru, M. Sokolov. • This software is developed for operation with experimental data of various devices (storage, transport, processing and results presentation). It allows to create the Data warehouse and to carry multi devices researches. • The software includes: • DB DASSQL for storage of the diagnostic and descriptive information of various devices. • Local archives DASFile for transport of data and off-line work with fragments of DB DASSQL. • Network service DASWeb for remote access to DB DASSQL from the Internet browser. • Network service DASTCP for remote access to DB DASSQL from applications. • Cross-platform library DAS Access for creation of user's applications in the environment of MS Windows and Linux, having remote access through the Internet to DB DASSQL, and also to local archives DASFile. • The set of Mex-functions of data reading from DB DASSQL and DASFile in MATLAB. • Utilities DASText, DASLoad and DASDec for data exchange as the text and binary files between DB DASSQL, DASFile and user's applications. • Multifunctional graphics shell DASTools with a package of mathematical processing DAS Processing for operation with experimental data of plasma devices.

_||_… _||_ Experimental shots Data Readers Industrial PCs with ADCs installed. Read multi-channel raw data. Compress data. Create data files. Data Center High perf. PC or blade-servers unit. Integrates and saves many data files into one, loads data into database. Database Server High perf.PC. SQL- database stores raw and processed data of experiments, incl. data from other experim. devices. Currently 200 Gb + Application server High perf. PC Runs services and data handling routines. Acts as a server for remote terminals. Data math.processing DB loading/extracting Data files reading Service1for client programs (TCP) Service2 for remote terminals Web server High perf. PC Runs Web site with static descriptive information and facility of interactive access to the experimental data and to do more calculations. Service3 for Web clients to access data via browsers Service4for more mathematic calculations to be executed (http) . T-10 System modules and data flows. Efficient binary format Compressed data Integrated Data file of a shot 300 Mb + Data files Data files Other experimental devices Data converters Import data of other experimental devices. Export data into other formats (Text, XML, XLS, GIF,…) … Researchers are provided with full-featuredprogram utility for selecting, viewing and analysing the data. Researchers LAN / Internet Researchers can integrate provided library modules into their specific applications, and thus gain access to the data.

Full-featured program utilityfor data selecting, viewing and analysing, with a graphic user interface and rich variety of data processing and presentation ways (tables, 2D-, 3D-graphics, scaling, profiles). Can run on users’PCs (usually in LAN of the experimental installation) or on Application Server while in remote terminal mode*. Can work with local copies of the experimental data (data files). Provides a unified user interface for researchers (remote included). Program facilities for data access and analysis. to Service1 to Service2 Internet browserwith HTML-input forms as interfaces to access the experimental data. The data are selected and rendered on the server and the results are displayed in the user’s browser, in binary, text, graphic, image and media presentation. to Service3 Researchers can access the experimental data in several ways: Internet browser (SigmaWeb) with input forms allowing users to run certain mathematic routines on the server with user-defined initial data.The calculations are carried out on the server and the results are displayed in the browser. to Service4 Other user applications for experimental data processing and presentation can integrate library modules which implement connection to Application Server and thus the applications gain access to the experimental data. The user applications list includes Matlab, MDS, any Pascal,C++,Python, …- programs. to Service1 *remote terminal mode is an advantageous way of using full-featured program utility to access the data via the Internet, as it results in minimal data traffic over the network. In this mode a user is provided with the program interface, while fetching the data, calculations and rendering are carried out on the server.

Flow-chart of the main components

Unification of data access for various devices This software forms the common information system, which is built over the existing systems of data acquisition and over the existing data bases of experimental devices.

Network services T-10: DASTCP (for DASTools, DASAccess) 195.9.0.8:8888 DASWeb http://cpunfi.fusion.ru/dassql/dasweb2.dll/showgl SigmaWeb http://cpunfi.fusion.ru:8088/SIGMAFRAME.html Website T-10: http://T10.fusion.ru (also, useful links at the page “Database”) http://T10.fusion.ru/JE page of Joint experiment http://T10.fusion.ru/Files page of shared documents (from directory JE T10.WWW) http://T10.fusion.ru/DAST10 page of software DAS T-10 Network T-10 disks: Netware network, server Pls: \\pls\nw1 DAS T-10 software and documentation \\pls\nw2 T-10 users archives \\pls\jet10 common directory of JE T10 participants T-10 disks also can be accessed as: MS Windows network, workgroup Soflab, server NS: \\Softlab\\NS\DASPLS DAS T-10 software and documentation \\Softlab\\NS\T10Common T-10 users archives \\Softlab\\NS\JE T-10 Common directory of JE T-10 participants T-10 disks also can be accessed via FTP.FUSION.RU (secure SSL is preferred, for example WS_FTP client): /!JE T-10 Common directory of JE T-10 participants The Common directory of JE T-10 participants contains two folders: JECommon folder for archives and files exchange JEFile.WWW files from this folder are published on website http://T10.fusion.ru/Files NETWORK RESOURCES OF T-10

Structure of data records The fields Passport andData are not mandatory; they have the variable size and may be compressed. At storage and data transfer via a network, the data compression by a combination of delta-method and open algorithm Zlib is carried out.

Tree of records in DASSQL • Data ownership (Signals andparameters): • Group of names - Ch001..Ch999 • Domain – Ch.* • SQL search: • Device, Shot, • Date Time • Diagnostics, Name • Commentary • Indexing parameters (B, Ipl,U, …) The dynamic table of Indexing parameters: Key: Device-Shot-ParameterName. Values: Double / Datetime / Text

Various ways of data access and viewing.

DASSQL data acquisition system, storage, access and device search • Choice of data by criteria using the resources of SQL • For pulse experiments • Used in several Russian facilities • Rich set of interfaces • Unified format and the common methods of operation with various data. • Data compression in 3-6 times at storage and transmission via Internet. • Remote multi-user operation with data of many devices. • Specialized processing and the unified representation of results. • Possibility of the subsequent integration with the Grid infrastructure.

DASSQL/DASFile -- MATLAB Examples: [Names, ErrorMessage] =DASMexNames (‘dassql.ini’, ‘T10’, 37856); [Data, Passport, ErrorMessage] =DASMexData (‘dassql.ini’, ‘T10’, 37856, ‘Bol.d-01’, 1, 500, 1e5, 7e5);

DASWEB • DB DASSQL are automatically published in the Internet. • The Web-interface provides formation of inquiries through the Internet-browser. • Dynamic creation HTML and images, compression transmitted by Deflate. • Data processing are made on the side of a server, results in the form of graphic (GIF), tables (ASCII) or binary (DAS File) and transmitted to the user.

SigmaWeb:Run codes Start of a code is carried out on a following chain: {The client, the Internet a browser} - Internet HTTP/Post- {Application server, SigmaWeb} - Files: Input, OutPut, Errors, Status - {the Code} At start on platform SigmaWeb the code representing the simple console application working with files, becomes multi-user and receives the graphic interface in the form of the Internet of a browser. The code can represent group of the executed modules incorporated in a command file. Performance of a code in the multi-user mode is provided with creation of a temporary context for each started copy of a code. All network connections of clients with SigmaWeb are started in separate streams. SigmaWebconsole on Applications server.

SigmaWeb:Run math codeAT-Lighton the Server(Service4) Setting the initial data -> Sending request -> Viewing in browser the results of the calculations carried out on the server.

DASTOOLS • Access to a DB via Internet. • Work with local archives, text, binary and media files. • Effective navigation and work with data sets. • Fast mathematical processing - DAS Processing. • Integrated with the special codes. • Wide set of means of data presentation. • Work with big multichannel data and media formats.

DAS PROCESSING • Methods of the moving average (MA, WMAH, WMAT, Average). • Median filter. • Subtraction of shelf(Zero line). • Transformation of the AXIS «Y» (dimension). • Transformation of the AXIS «X» (dimension). • Suppression of casual emissions. • Inverting of the signal. • Allocation of positive values of the signal. • Detailed elaboration. • Extracting. • Normalizingthe signal on the maximum. • Calculation of the chord. • Interpolation given by multinominal of Lagrange. • Derivatives and integrals. • Data presentation of multichannel diagnostics in the form of structures and surfaces. • Addition, multiplication and division for groups of signals. • Fourieranalysis. • Use of graphics of harmonious fluctuations. • Fitting of function approximation of many variables to experimental data. • Methods DAS Processing are accessible through network services DASWeb and DASTCP, library DAS Access and taskinterface DASText.

Nuclear Fusioninter-facilities collaboration A lot of standards applied

Nuclear Fusioninter-facilities collaboration • Unified interoperation needed

PROSPECTIVE • The DAS is going to be modernized to accommodate increasing amounts of experimental data. • Modern electronic equipment and computational concepts are going to be used, • including blade-servers and parallel multi-channel data processing. • The System future development will keep up a cooperation with other researchers for working out common standards for better interoperability of different data-systems in nuclear fusion experimental field. • This cooperation includes issues of integration into scientific structures based on Grid-technologies and other prospective formations. • The System as the whole or its parts can be used in different applications: • - development of new data-systems for any devices; • integration its data viewing/processing/analysis utilities into existing data-systems; • storing large amounts of data from other data sources in the System database with ability to manipulate this data with the DAS utilities.

CONCLUSION • This software forms the information system, which is built over the existing systems of data acquisition and over the existing data bases of experimental devices. • At present, the records from devices: T-10, GTB, PN-3, PS-1, S-300 (RRC KI), CASTOR (host lab experiment, IPP, Praguesep.2005) and also separate shots from devices: TUMAN-3M, GLOBUS, L-2M are presented in the DB DASSQL. • The following possibilities of operations with experimental data have been realized: • Choice of data by criteria using the resources of SQL • Rich set of interfaces • Unified format and the common methods of operation with various data. • Data compression in 3-6 times at storage and transmission via Internet. • Remote multi-user operation with data of many devices. • Specialized processing and the unified representation of results. • Possibility of the subsequent integration with the Grid infrastructure.

Report from A+M Data Centre, RRC “Kurchatov Institute”