280 likes | 303 Views
VLAM-G is a collaborative analysis environment facilitating remote experimentation and data sharing. It provides a platform for defining, executing, and monitoring experiments with seamless access to distributed resources and workflow support for various scientific domains.
E N D
VLAM-G Project VLAM-G developers team Computer Architecture and Parallel Systems GroupDepartment of Computer ScienceUniversiteit van Amsterdam National Institute for Nuclear and High Energy Physics Institute for Atomic and Molecular Physics
Outline • Introduction • Objectives • VLAM-G Principles • VLAM-G Architecture • VLAM-G & DASII • VLAM-G Application Examples • Conclusions
VLAM-GVirtual Laboratory AMsterdam A collaborative analysis environment for applied experimental science Grid and VLAM is about sharing resources: • physical equipment (remote experimentation) • Data & Information repositories
Application Layer Virtual Lab. Grid Layer
Objectives & realization Methods • Enable VLAM-G users todefine, execute, and • monitor their experiments • Provide to VLAM-G users: • location independent experimentation, • familiar experimentation environment • assistance during their experiments • Easy way to bring/port new/existing applications to the Grid • Developing application prototypes to check ideas and to learn
Objectives & realization Methods • Application layer • Case studies • Provides VLAM-G modules • Middle layer (Top) • Hides the details of the Grid • Offers an information management system
VLAM-G Architecture VLAM-G Client collaboration Module Repository SessionManager Assistant M1 RTS M2 Mn VIMCO Grid/Globus Services RTS DB PFT DB Resource A Resource B
VLAM-G Run Time System on DAS-2 VL module 2 VL module 4 VU RTSM VLAM-G GUI VL module 1 VL module 5 NIKHEF DAS-2 VL module 3 RTSM - VLAM-G Run Time System Manager - VLAM-G experiment module VL module 1 VLAM-G GUI - VLAM-G Graphical User Interface
node node node node node node RTS DB App. DB Job management on DAS-2 Other subclusters: Other subclusters: VL module 2 node VL module 1 GUI Node 2 SM VL module 4 node Node 0 VIMCO Node 3 node RTSM PBS over Globus PBS over Globus Node 1 ... ... VL module 5 Node N Subcluster (e.g. at NIKHEF) Subcluster (e.g. at NIKHEF) VL module 3
Process Flow Template(PFT) • Used as a blueprint for a specific type of experiments • PFT is designed offline by the experts in each scientific domain • It is the main interface used by the VLAM-G users to perform a specific experimentation in the VLAM-G environment. • It Guides the user while performing the experiment.
Define the context f the experiment (GUI) MACS EFC Expressive Application databases The PFT (cont.) PFT (GUI) Compose the experiment (GUI) Experiment Editor RTS VIMCO Resource A
Owner Literature Photograph Empty Interpretation Data Cube Sample Extraction Cerf. Tool Settings Treatment DC Analys. Q. Ctrl Apparatus Ana Tool Treated sample Data Cube Raw Data Conversion Process Flow Template Surface Scan
Status of the VLAM-G Prototype • The first Beta-release is almost ready • This release will contain: • A tool to load modules in the VLAM-G database • A list of modules that can selected and used • C/C++ API to write VLAM-G modules • Support for the MACS and DNA array experiments • It should be conform to the Globus security • It is going to be running on DAS-2
The histogram demo • This demo. is about running jobs on different Grid enabled machines using the VLAM-G environment. • Two modules: • Slider • Visualization
Floating ball experiment • This experiment is about controlling remote external devices using the VLAM-G environment. • Two modules: • controller • Visualization
The MRI scan experiment • This experiment is about running jobs on different Grid enabled machines using the VLAM-G environment. • Four modules: • MRI scanner • Converter to NetCDF • Visualization Modules: 2D and 3D
MACS (Material Analysis of Complex Surfaces) • Remote experimentation (m-beam) • Data storage • Meta-data analysis (combine data from different sources)
MACS lab Devices m-beam TOF-SIMS FTMS FTIR mscoop
What is needed? • High speed network • Huge computing power • Analytical Instruments / Data • Micro-beam, FTIR, TOF-SIMS, … • Capable database, generic data format • Software (“The glue”) • The Virtual Laboratory env. “ VLAM-G”
Sample Meta-data analysis VL database
Owner Object Sample_Extraction Sample Sample_Treatment Treated_Sample Data Cube Data Cube Material_Analysis DC_Analysis Analysis_Tool File_Conversion Conversion_Tool Experiment Process Flow Template Literature Photo_Image Results_Observations Physics_Device
Conclusions • VLAM-G: a science portal for exp. analysis • Workflow support forBio-informatics, Materials Scienceand Biomedical Simulation & Visualisation • Seamless access to distributed resources • Resource Management: based on Globus • Content Management: VLAM-G middleware • Current status: preparing the beta-release of the VLAM-G toolkit.
Where to find about the VLAM-G projects VLAM-G home page • http://www.dutchgrid.nl/VLAM-G