1 / 27

SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481

Workflow-Oriented Science Gateway for Astrophysical Visualization. Eva Sciacca M. Bandieramonte , U. Becciani , A. Costa , M. Krokos , P. Massimino , C. Petta , C. Pistagna , S. Riggi and F. Vitello eva.sciacca@oact.inaf.it.

shanae
Download Presentation

SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Workflow-Oriented Science Gateway for Astrophysical Visualization Eva Sciacca M. Bandieramonte, U. Becciani , A. Costa , M. Krokos, P. Massimino , C. Petta, C. Pistagna , S. Riggi and F. Vitello eva.sciacca@oact.inaf.it SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI-283481

  2. Motivations • Several TBs are often generated by modern cosmological simulations and large-scale astrophysical observations are stored in archives. Such large data volumes pose significant challenges in terms of data analysis, storage and access; a critical step forward in understanding, interpreting and verifying their intrinsic characteristics can be achieved trough visualization. • DCIs access • Multiple users need to share visualization experiences, by interacting simultaneously with astrophysical datasets giving feedback on what other participants are doing/seeing. • Collaborative environment • The reproduction of specific visualization results is a challenging task as selecting suitable visualization parameters may not be a straightforward process. • Workflow-driven application

  3. SCI-BUS Project SCI-BUS aims to create a generic-purpose gateway technology as a toolset to provide seamless access to major computing, data and networking infrastructures and services in Europe. www.sci-bus.eu

  4. Outline • Background • Science Gateway • Workflow System • WSPGrade/gUse • VisIVO Science Gateway • Visualization and Analysis Tools • Portlets and workflows • VisIVO Mobile • Case Study • Results

  5. Science Gateway • It is a community-developed set of tools, applications, and data collections that are integrated via a portal or a suite of applications. • Gateways provide access to a variety of capabilities including workflows, visualization, resource discovery and job execution services.

  6. What is a Workflow? • A workflow consists of a sequence of connected steps • Scientific workflows allows scientists to model, design, execute, debug, re-configure and re-run their analysis and visualization pipelines. • Part of the established scientific method is to create a record of the origins of a result: how it was obtained, datasets and experimental methods used, machine calibrations and parameters, etc. • Such information is useful for a scientist to interpret their workflow results and for other scientists to establish trust in the experimental result and re-use all the computational pipeline.

  7. Workflows The skeleton of a workflow is represented by a Graph. Jobsdenote the activities, which envelop insulated computations Channels are directed edges of a graph, directed from the output ports towards the input ports.

  8. WSPgrade/gUse • (grid and cloud User Support Environment) is a DCI virtualization environment providing a scalable set of high-level services by which interoperation between DCIs and user communities can be achieved. • The WS-PGRADE Portal is a web portal of the gUSE. It supports development and submission of distributed applications executed on the computational resources of various distributed computing infrastructures including clusters, grids and clouds. • A web application framework constructed of functional units called portlets. http://www.guse.hu http://www.sourceforge.net/projects/guse

  9. VisIVO Science Gateway • The VisIVO Science Gateway is designed as a workflow enabled grid portal that is wrapped around WS-PGRADE providing visualization and data management services to the scientific community. • The gateway offers role-based authorization modules and supports login with user name and password. Standard User uses Workflow developed by a “workflow developer” through an ASM. Advanced User, can develop and configure workflow. All gUse functionalities are available.

  10. Architecture

  11. Visualization and Analysis Tools Local or Remote (URL) User Data VisIVOImporter VBT: VisIVO Binary Table VisIVOFilters New VBT VisIVO Viewer https://sourceforge.net/projects/visivoserver

  12. Visualization Navigation -- Zoom -- Palette -- Algorithms -- Data selection -- Picker op.

  13. Portlets…

  14. … and workflows

  15. VisIVO Mobile

  16. A short demo http://visivoportal.oact.inaf.it:8080 • Viewthe demo HERE

  17. A case study: Muon Portal Prototype  muon track deviation The Project: Exploring the container content searching for nuclear material (uranium, plutonium) Compute: coordinates and deviation angle that the muon track has when high-Z material element is in the path.

  18. Results

  19. Workflow

  20. Dataset Processing Input Dataset FilteredDataset (Thresholdfiltering) POCA Un-FilteredDataset

  21. Isosurface Images FilteredDataset Un-FilteredDataset

  22. Panoramic Movies FilteredDataset Un-FilteredDataset

  23. Tomographic Images FilteredDataset Un-FilteredDataset

  24. Conclusions • A workflow-oriented gateway allows scientists to share their analysis workflows and identify best practices for investigating their datasets. More importantly, they can automate workflows for repeated analysis with changed parameters. This way scientists can focus on their core scientific discoveries as opposed to spending time in data analysis on inadequate resources. • Through the shareable workflows and reusable portletsof the gateway, not just astrophysicists but also other scientific fields scientists can exploit the developed technologies.

  25. Thankyou for yourattention!

  26. Development Tools A free, open-source Integrated Development Environment for software developers. A web application framework for Rich Internet Applications. It features a robust server-side architecture. It offers a large collection of UI components such as Buttons, Tables, Trees and Layouts. The components use events, listeners and data binding to communicate with each other and with the business logic.

  27. VisIVO DCI Infrastructure VisIVO Gateway: Infrastructures • Trigrid Cluster - AMD Dual Opteron 280 2.4 GHz, 14 Blades with 4 cores with 8 GB RAM / Blade (52 CPU core) - Total storage: 3.7 TB (lsf) • 2 X Server Intel Xeon 3060 2.4 GHz, Dual-Core, 2 GB RAM - Total storage: 23 TB • Server Intel Xeon 3050 2.13 GHz, Dual-Core, 2 GB RAM - Total storage: 8 TB • Hybrid system  cpu-GPU, N 2:  Intel(R) Xeon(R) CPU           E5620  @ 2.40GHz, 24 GB RAM DDR3-1333 NVIDIA TESLA C2070, 448 cuda core + 6 GBRam • COMETA grid – gLite nodes ~1500 CPU/core (250 hosted at INAF-OACT) AMD Dual Opteron 280 2.4 GHz (jdl)

More Related