1 / 26

Grid Middleware, Grid Canada

Grid Middleware, Grid Canada. darcy.quesnel@canarie.ca. Globus Toolkit 4. Open source project Under development since 1996 Hosted by DOE Argonne National Laboratory USC Information Sciences Institute. Now overseen by the Globus Alliance Argonne, ISI EPCC, University of Edinburgh NCSA

octavia-gillespie
Download Presentation

Grid Middleware, Grid Canada

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Grid Middleware, Grid Canada darcy.quesnel@canarie.ca

  2. Globus Toolkit 4

  3. Open source project Under development since 1996 Hosted by DOE Argonne National Laboratory USC Information Sciences Institute Now overseen by the Globus Alliance Argonne, ISI EPCC, University of Edinburgh NCSA KTH, Sweden Univa Corporation Funded by NSF IBM DOE NASA DARPA European Commission UK Research Councils Microsoft Background

  4. Commercial partners in the Globus Consortium HP IBM Intel Sun Nortel Univa Enterprise Grid Alliance Data Synapse EMC2 Fujitsu HP Intel NEC NetApp Oracle Sun … Background

  5. Background • Various versions of Globus in use by a number of “large science” projects • Sloan Digital Sky Survey • National Virtual Observatory • Collaboratory for Multi-Scale Chemical Science • Network for Earthquake Engineering Simulation • Earth System Grid • Access Grid • Science Environment for Ecological Knowledge • Laboratory for the Ocean Observatory Knowledge Integration Grid • Particle Physics Data Grid • NAREGI • Enabling Grids for e-Science (EGEE) • Open Science Grid • TeraGrid • UK e-Science • …

  6. Components courtesy Globus Project

  7. SSL/WS-Security with Proxy Certificates Services (running on user’s behalf) Authz Callout Access ComputeCenter Rights CAS or VOMS issuing SAML or X.509 ACs Rights MyProxy Local Policy on VO identity or attribute authority Rights KCA GT4 Security Users VO courtesy Globus Project

  8. GT4 Security courtesy Globus Project

  9. Data Management • Discover, transfer, and access large data sets • Stage large data sets to/from nodes and provide access to diverse data sources, file systems, parallel file systems, and hierarchical storage, GridFTP • Replicate data for performance and reliability, RFT • Locate data of interest, RLS • Provide access to databases, OGSA-DAI

  10. Execution Management • Provision, deploy, and manage services • Common WS interface to schedulers • Unix, Condor, LSF, PBS, SGE, … • More generally: interface for process execution management • Lay down execution environment • Stage data • Monitor and manage lifecycle • Kill it and clean up • A basis for application-driven provisioning • This is where WSRF and WS-N come in

  11. Information Services • Discover and monitor dynamic services • “Every service should be monitorable and discoverable using common mechanisms” • WSRF/WSN provides those mechanisms • A common aggregator framework for collecting information from services, thus: • MDS-Index: XPath queries, with caching • MDS-Trigger: perform action on condition • MDS-Archiver: XPath on historical data • Deep integration with Globus containers & services: every GT4 service is discoverable • GRAM, RFT, GridFTP, CAS, …

  12. User Application User Application User Application Tool Tool Reliable File Transfer Uniform interfaces, security mechanisms, Web service transport, monitoring MDS-Index MyProxy DAIS GRAM User Svc User Svc GridFTP Host Env Host Env Database Computers Storage GT4 In Action courtesy Globus Project

  13. Implementations • Multiple implementations of the web services parts (WSRF, WSN) • GT4-Java, Java • GT4-C, C • pyGridWare, Python • WSRF::Lite, Perl • WSRF.Net, C#

  14. Ecosystem • MPICH-G2, MPI in the wide-area • Nimrod-G, parameter studies • Ninf-G, remote procedure calls • Condor-G, reliable job submission • Grid Resource Management System, metascheduler • Open Grid Computing Environment, portal

  15. Community • Global Grid Forum • SuperComputing • Various peer-reviewed conferences

  16. Grid Canada

  17. SAFORAH Canadian Forestry Grid LHC ATLAS Grid Canada Drivers LHC

  18. Grid Research Centre at U Calgary Rob Simmonds, Brian Unger, &c Grid Group at U Windsor Bob Kent, A.K. Aggarwal, &c Atlas Canada Randy Sobie, U Victoria, Bryan Carron, U Alberta, Michel Vetterli, TRIUMF, &c CRIM Pierre Duchoumel, &c International Grid Testbed Bryan Carron, U Alberta, Wade Hong, Carleton U, &c NRC Internal HPC Programme / Multi-Scale Modelling Project Roger Impey, &c UQAM Omar Cherkaoui, &c Canadian Grid Groups

  19. Grid Canada • Informational and consultative functions, a forum for interested parties • www.gridcanada.ca • giis.gridcanada.ca • Information service, resources attached to the Grid Canada testbed and a production grid effort, Grid-X1 • www.gridcanada.ca/ca/ • Grid Canada Certificate Authority • myproxy.gridcanada.ca • We’re looking at other

  20. Grid CanadaCertificate Authority • Issues certificates to users and resources involved in grid-related research in Canada • Atlas Canada, NRC Grid, WestGrid, and anyone else who wants to talk to us (!) • Certificates are used in the context of PKI as implemented by grid middleware such as Globus • CA operations are (securely) housed at NRC with Ratilal Haria handling day-to-day certificate signing • Process is documented in our CP/CPS • http://www.gridcanada.ca/ca/ • Many legal issues side-stepped or “not stipulated”

  21. GC CAIssued Certificates • Around fifteen hundred issued certificates • Mainly Westgrid users (!) • Not all are active • User and host certificates • Some are revoked • Many are expired • Certificates expire after a year but can be renewed • We’ve been issuing certificates since April 2002

  22. GC CAExternal Relations • Trust between CA’s about the processes which we follow • Certificates from one CA are “allowed” to authenticate with those of another • GC CA has trust relationships with all the CA’s associated with the EU Grid PMA • http://www.eugridpma.org/ • In response to the need for Canadian researchers to access international resources such as LCG • GC CA is listed in the TERENA TACAR, a reliable repository

  23. GC CA External Relations • The Americas Grid Policy Management Authority (TAGPMA) • Grid Canada, DOEGrids, FermiLab, &c • Main drivers are large projects such as OSG and Teragrid • Canadian researchers will be able to access TeraGrid resources soon with GC certificates

  24. GC CA External Relations • Global Grid Forum, Certificate Authority Operations Working Group • Documents, both finished and in the pipeline • Deal with PMA issues as well as a publishing point • www.ggf.org

  25. GC CAExternal Relations • International Grid Trust Federation • Formed at the last GGF in Boston • Regroups EUGridPMA, APGridPMA, and TAGPMA • Allows for international trust to be established • This represents 10’s of thousands of users, and 10’s of thousands of resources

  26. Questions? • Contact me • darcy.quesnel@canarie.ca

More Related