1 / 24

O utline

A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed Worldwide Big Data, Big Network Workshop – 10 October 2013. Roberto Barbera and Diego Scardaci – INFN Catania - Italy { roberto.barbera , diego.scardaci } @ct.infn.it .

varana
Download Presentation

O utline

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Standard-based Science Gateway Framework to Seamlessly Access HPC, Grid and Cloud Resources Distributed WorldwideBig Data, Big Network Workshop – 10 October 2013 Roberto Barbera and Diego Scardaci– INFN Catania - Italy{roberto.barbera, diego.scardaci}@ct.infn.it

  2. Introductoryconcepts and drivingconsiderations • Vision and use cases • Currentresults • Activities in Latin America • Summary and outlook Outline Big Data, Big Network Workshop - 10 October 2013

  3. Cost of hw Cost of networks Evolution of distributed computing Time decrease 90’s-00’s Grid Computing 00’s-10’s Cloud Computing 80’s-90’s Cluster Computing Mainframe Computing CPU power WAN bandwidth increase

  4. Research Networks at “global” scale Big Data, Big Network Workshop - 10 October 2013

  5. The “Global” Grid Big Data, Big Network Workshop - 10 October 2013

  6. The “non-global” middleware Genesis II Interoperability and easiness of access are issues Big Data, Big Network Workshop - 10 October 2013

  7. Cloud «sky» isnotless …«cloudy» Big Data, Big Network Workshop - 10 October 2013

  8. The CHAIN-REDS Project(www.chain-project.eu) Started: 1 Dec 2012 Duration: 30 months Targetedregions: Africa, Arab Region, Latin America, China, India, and Far-East Asia

  9. According to ISO/IEC 2382-01 (Information Technology Vocabulary, Fundamental Terms), interoperability is "The capability to communicate, execute programs, or transfer data among various functional units in a manner that requires the user to have little or no knowledge of the unique characteristics of those units“ • In engineering, interoperation is the setup of ad hoc components and methods to make two or more systems work together as a combined system Interoperability and interoperation(source: Wikipedia) Adoption of standardsis key Big Data, Big Network Workshop - 10 October 2013

  10. A scientist can seamlessly run applications on HPC machines, Grids and Clouds based on different middleware • ( to demonstrate interoperability  use case #1) • The cloud tenantof a real or virtual organisation can seamlessly and easily manage Cloud resources pledged by providers owning infrastructures based on different Cloud middleware stacks • ( to demonstrate interoperation  use case #2 ) Vision Big Data, Big Network Workshop - 10 October 2013

  11. CHAIN-REDS Demo contributors Big Data, Big Network Workshop - 10 October 2013

  12. Auser can sign in on a Science Gateway using his/her federated credentials, select an application from a menu and seamlessly execute it on HPC machines, Grids and Clouds • The fractions of executions on the three different platforms can be adjusted to simulate the need to “boost” the resources in case of temporary peaks of activity Use case #1 (scientist) Big Data, Big Network Workshop - 10 October 2013

  13. Web: http://www.egi.eu/infrastructure/cloud/ Wiki: https://wiki.egi.eu/wiki/Fedcloud-tf A reference infrastructure: the EGI Federated Cloud use case #1 use case #2 Big Data, Big Network Workshop - 10 October 2013

  14. Administrator Scientist Cloud tenant Embedded Services ....... Catania Science Gateway Framework architecture App.2 App.1 MyCloud Catania Science Gateway Use case #1 Use case #2 CLEVER Orchestrator (based on OCCI) Grid/Cloud Engine (based on SAGA) HPC Clusters Usersbelonging to Identity Federations Cloud #1 Cloud#2 Cloud#n Single logical domain

  15. Official Identity (Inter-)Federations currently supported by Catania Science Gateways VAMP Workshop 2013 – Helsinki, 30/9-1/10/2013

  16. Other IdPsdeployed in Latin America Big Data, Big Network Workshop - 10 October 2013

  17. LiferayPortlets Science GW 1 Science GW 3 Science GW 2 The Catania Grid& Cloud Engine Grid/Cloud Engine Science GW Interface eToken Server UsersTrack & Monit. Users Tracking DB Data Engine Job Engine SAGA/JSAGA API Grid/Cloud/Local MWs New New Updated New Updated Updated

  18. Running applications on the EGI Federated Cloud Big Data, Big Network Workshop - 10 October 2013

  19. Running applications on the EGI Federated Cloud

  20. Running applications on various types of e-Infrastructures Big Data, Big Network Workshop - 10 October 2013

  21. Science Gateways in Latin America: the GISELA Science Gateway (http://gisela-gw.ct.infn.it) Big Data, Big Network Workshop - 10 October 2013

  22. As part of the SCALAC model, the GISELA SG has been re-installed and updated at UNAM (Mexico) and named SCALAC SG • The SCALAC SG is in progress to be relocated at: https://sgw.scalac.redclara.net • As part of the SCALAC commitments, CUDI (the Mexican NREN) is financing two pilot projects for new services: access to HPC and to Cloud infrastructures via the SCALAC Science Gateway • The SCALAC Science Gateway will be operational by the end of 2013 • The SCALAC SG will be connected to the “Identity Provider of the Mexican Advanced Computing Services for e-Science” and to all other IdPsbeing established in Latin America in the context of the ELCIRA project El Servicio de Computación Avanzada América Latina y el Caribe https://comunidades.redclara.net/wiki/scalac/index.php/SCALAC

  23. Standard-basedinteroperabilityshould be enablednotonlyacrossmiddlewarebutalso and more importantlyacrosscomputingparadigms (Grid, HPC, Cloud, local clusters, desktops, etc.) in order to exploit big networks asmuchaspossible • Catania Science Gatewayssuccessfully bridge e-Infrastructuresdevelopedaccording to differentmodelsarchitectures and maketheminteroperableatuserapplicationlevelthanks to standard adoption (SAGA, SAML, OCCI, CDMI, JSR286, etc.) • The MyCloud service allowsseamless multi-cloud service operationacrossdifferent OCCI-compliantmiddlewarestacks on manysitesworldwide • Nextsteps are: • Creation of the sharedstorageinfrastructure to supportstatefulVMs • AllowdeployedVMs to «findthemselves» in MyCloud • Fostering the deployment of cloudinfrastructures in the regionsaddressed by CHAIN-REDS to widen the testbedboth in size and geographiccoverage • Promotion of the EGI FedCloud model and possibleextension of itsinfrastructure to otherregions in order to support global VRCs Summary and outlook Big Data, Big Network Workshop - 10 October 2013

  24. Questions ?

More Related