1 / 33

SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop:

Southeastern Universities Research Association. SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation January 5-7, 2005. Art Vandenberg Avandenberg@gsu.edu Director, Advanced Campus Services

valmai
Download Presentation

SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop:

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Southeastern Universities Research Association SURA NMI Utility Grid: Sharing Resources, Sharing Results SURA Cyberinfrastructure Workshop: Grid Application Planning & Implementation January 5-7, 2005 Art Vandenberg Avandenberg@gsu.edu Director, Advanced Campus Services Georgia State University

  2. NMI Participation Implementers Target Communities NMI Integration Testbed NMI Integration Testbed USERS Sites CONTRIBUTORS UAB UAH UFL FSU GSU UMich TACC UVA REU Students DEVELOPERS Testbed Grid SUPPORTERS future expansion ? (USC) The NMI Integration Testbed • Managed by SURA under NSF ANI-0123937 • Testbed Sites evaluate NMI components • Real life research and enterprise contexts • www.nsf-middleware.org/testbed

  3. SURA NMI Testbed Grid • Initiated as a sub-project in September 2003 • Captured dispersed activity into meaningful deliverables • Integrate NMI grid components into the enterprise • Leverage the NMI Testbed experience • Identified leads for key areas: • Georgia State University • “Grid-building” (identifying participants, resources) • application development (cataloging, exploration) • University of Virginia • Scaling the Grid • Technology & policies for cross-certification • Secure inter-institutional access

  4. SURA NMI Testbed GRID: vision & action • Vision – build a model of future grid • Address interoperation - Bridge CA • Persistent, available resources • Applications run transparently • Policy is one of cooperative computing • SURA NMI Testbed Grid • Continuing NMI Integration Testbed work • Persistent resources for research and education • Research, learning, outreach

  5. What we’ll review… • Catalog of Grid Applications: data • SURA NMI Testbed GRID: participants & resources • Applications: value proposition / outreach • Portals: eye of the beholder • Authentication: BridgeCA • Policy: boundary conditions • Current status

  6. Catalog of Grid Applications: data • Information is a resource – researchers, grids, applications (existing & potential) – 20 Universities, 475 researchers as of Oct 28, 2004… • http://art12.gsu.edu:8080/grid_cat/index5.jsp

  7. Query: computational fluid dynamics • Search by name, institution, keywords

  8. Possible collaboration, information exchange • Computational fluid dynamics + parallel computing

  9. Grid Catalog: Coming up • Online submission of information • Additional search function: clustering around target info • Information on resources

  10. UMICH GMU UAH UARK UVA GPN USC DUKE SC TTU GaTech TACC UAB GSU Tulane LSU SURA NMI Testbed GRID: participants…

  11. Applications: multiple genome alignment Multiple Genome Alignment Grid-enabled algorithm Nova Ahmed, Masters CS (Ph.D. student as of Jan 2005); Dr. Yi Pan, Computer Science UAB Clusters and collaboration Computation time of multiple sequence alignment program - varying number of elements per processor in different configurations - using 9 processors in each config (cluster, grid cluster, multi-grid cluster) NOTE improvement using MPICH-G2across multiple clusters (research follow up…?)

  12. Task Farming & Cross Certification • LSU: Center for Computation & Technology • Supercomputing 2004 –demonstration • Explore parameter space for black hole simulation • Task farming • Submit tasks to grid • Tasks run on various available nodes • Tasks can be transitioned to another node “if needed” • Cross certification at SURA NMI Testbed Grid BridgeCA • Enables transparent authentication

  13. Information Technology & Systems Center Global Hydrology Resource Center http://datapool.nsstc.nasa.gov • Interactive data search by product, instrument, platform, and date • Multiple views of data, e.g. search, ftp or calendars • Automated order packaging for FTP delivery • Direct FTP access to online data sets • Subsetting capability • Shopping cart style order creation • DODS/OPeNDAP data access DISCOVER- Distributed Information Services for Climate and Ocean Products and Visualizations for Earth Research

  14. Georgia State Cosmic Ray Lab Muon-detector Grid – Georgia high schools, middle schools • Dr. Xiaochun He, Georgia State, Physics – research, outreach...

  15. University of Arkansas • Dr. Amy Apon – Grid Education • International Workshop on Grid Education • Grid.Edu 2004 (April 2004) • NSF CCLI: Adaptation of GT3 Tutorials for undergrad CS • Collaborative with Jens Mache, Lewis & Clark College • http://csce.uark.edu/~aapon/courses/gridcomputing/ • Member TCSC subcommittee on grid computing education • Great Plains Network Consortium,Extending the Reach Project • Goal: region-wide collaboration • Goal: middleware infrastructure to share resources • Deployment of Shibboleth (model for Grid AuthN/AuthZ?) • http://archie.csce.uark.edu/gpn/ • Grid resources for graduate education

  16. And more application potentials… • University of Alabama – BLAST • Texas Tech – math and statistics, approximation theory • George Mason University – geospatial data services • Texas Advanced Computing Center – computational fluid dynamics • Tulane – computational fluid dynamics • UMich – ATLAS, G4Sims • Georgia State – particle simulation • Georgia Tech – network end-to-end performance

  17. Portals: eye of the beholder • OGCE – http://www.collab-ogce.org/nmi/index.jsp

  18. UTGrid: http://www.utgrid.utexas.edu/

  19. Mgrid: http://www.mgrid.umich.edu/

  20. U. Alabama at Birmingham:http://uabgrid.uab.edu/

  21. Georgia State:http://acsgridhead.gsu.edu

  22. U. of Southern California: http://www.usc.edu/uscgrid

  23. Portal considerations… • Common portal for SURA NMI Testbed Grid or • Portal of Portals • Integration with Authentication • “Just give me a command line!” • Identity for SURA NMI Testbed Grid • Our policy • Our members • Our resources • Our applications

  24. Typical Hierarchical PKI Typical Bridge PKI Authentication: Bridge CA

  25. AuthN: BridgeCA it works! • Jim Jokl, UVA, supports BridgeCA • LSU Center for Computation & Technology – Task farming demo Supercomputing 2004 • Tasks submitted to various grid-enabled clusters • LSU submitted to UVA cluster with cross-certification • LSU credential accepted by UVA cluster via BridgeCA • Current Status cross-certification with BridgeCA: • UVA, UAB, LSU (completed) • TACC, USC are nearly done • UAH, UARK, GSU, UMICH next phase • Next: automatic provisioning of Globus Grid Mapfile

  26. AuthN: additional links • SURA NMI Testbed cross certification process https://www.pki.virginia.edu/nmi-bridge/ • PKI-Lite policy, practices, profiles http://middleware.internet2.edu/hepki-tag/#PKI_Lite • CA Software (Options for Enterprise CA) http://middleware.internet2.edu/hepki-tag/opensrc.html • SURA “Thinking Group” report: SURA Certificate Authority Jan. 26 – Mar 29, 2004 See Appendix A at:http://www2.gsu.edu/~wwwacs/GRID_Group/min2Dec2004.htm

  27. Policy: from Formal… • Policies vary around the Testbed • Formal policy – USC (http://www.usc.edu/hpcc/) • “The use of rcf-01 and hpc is controlled by the HPCC Allocations Committee, under the authority of the HPCC Steering Committee. You must fill out an application and submit it to the Allocation Committee to obtain permission to use these facilities. • HPCC Allocation Policy • HPCC Allocation Request Forms” • See alsohttp://www.usc.edu/isd/services/accounts/ • Formal policy – Grid3 (http://www.ivdgl.org/grid3/userinfo/) • Project specific (ATLAS, LIGO, iVDGL…) • General Grid3 user registration (1 page guide)

  28. Policy: … In-process, informal, none… • In-Process Policy – UAB • “UABGrid is currently available to members of the UAB community and we are working on extending its availability across partner institutions and beyond.” http://uabgrid.uab.edu/ • No Grid specific policy – default user account policies • No formal policy, but may have consequences:

  29. Policy: evolving model… • What is SURA NMI Testbed Site policy? • Observation on Policy for Grid based resources • Must address assumption of local use only • Absent Grid policy, default to “computer usage” policy • Cross-boundary use of local credentials not norm • Social factors (Sharing resources – Yours? vs. Mine?) • Current SURA NMI Testbed Model • Contribute some, use some • Cross certify via BridgeCA • Allow over-subscribing and then address how to handle • Cooperative Computing – self-organizing/regulating? • Demonstrate value…

  30. Post-NMI Integration Testbed Award • SURA “Grid Think” Working Groups (Jan 2003) • Authentication/CA recommendations • Grid application analysis • Workshop planning (Like this event!) • NMI Submission for “Utility Grid” (May 2004) • Grids for broad, shared use across institutions (not just “big science”) • Focus on education, research, outreach • No award, but important development of concepts • Foundational resource for SURA HPC-Grid Planning Group

  31. SURA Testbed Grid: Basic approach… • Dedicated cluster • Persistence is important • Number of nodes: whatever you can manage • Linux • Globus • Compiler • Cross certification with BridgeCA preferred (other options ok) • SURAGrid@sura.org list • Biweekly conference calls • Minutes: http://www2.gsu.edu/~wwwacs/GRID_Group/NMI.html • Join US

  32. Q&A? Art Vandenberg Avandenberg@gsu.edu Director, Advanced Campus Services Georgia State University

More Related