1 / 31

Overview and Status Updates of ApGrid

Overview and Status Updates of ApGrid. Yoshio Tanaka National Inst. of AIST Grid Tech. Research Center. What is ApGrid?. Asia-Pacific Partnership for Grid Computing . ApGrid focuses on Sharing resources, knowledge, technologies Developing Grid technologies

yan
Download Presentation

Overview and Status Updates of ApGrid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Overview and Status Updates of ApGrid Yoshio Tanaka National Inst. of AIST Grid Tech. Research Center

  2. What is ApGrid? • Asia-Pacific Partnership for Grid Computing. • ApGrid focuses on • Sharing resources, knowledge, technologies • Developing Grid technologies • Helping the use of our technologies in create new applications • Collaboration on each others work • Not only a Testbed • Not restricted to just a few developed countries, neither to a specific network nor its related group of researchers • Not a single source funded project

  3. ApGrid History • Asia-Pacific GF meeting in Yokohama, Japan with Charlie, Ben Siegel, Youichi, Satoshi^2, etc. (July 2000) • Presentation at GF5 in Boston by Satoshi Sekiguchi (Oct. 2000) • Exhibits at HPC Asia (Sep. 2001) • 1st ApGrid Workshop in Tokyo (Oct. 2001) • Exhibits at SC2001 • Research Exhibition: Asia-Pacific Grid • ApGrid Panel in SC Global, SC2001 • 1st ApGrid Core Meeting in Phuket (Jan. 2002)

  4. Japan Laboratories AIST, RIKEN, KEK… Universities Titech, Tsukuba, Osaka… Korea KISTI Grid Forum Korea TEIN: a link to Europe and Japan Australia ANU/APAC, Monash U, Adelaide Malaysia USM Thailand NECTEC Kasetsart University KMIT Taiwan NCHC Academia Sinica Singapore NUS, NTU, iHPC, … United States SDSC, Indiana U. Potential Asian Partners Canada China Hong Kong Other A-P countries Vietnam, India,etc .. ApGrid Locations,Potential Partners

  5. 1st Asia Pacific Grid Workshop in Tokyo (22-24, Oct. 2001) • 3 Tutorials • Globus, Condor, Ninf • 3 Keynotes • Chip Cox (NSF) • William Johnston (NASA) • Ed Seidel (Max-Planck-Inc/NCSA) • GGF updates • Charlie Catlett, William Johnston, Steve Tuecke, Jennifer Schopf, Mary Thomas, Satoshi Matsuoka • Vendor Session • Fujitsu, NEC, Sun, … • Technical Session

  6. SC 2001 Exhibition • AIST, Japan • Ninf-G: GridRPC system • TIECH, Japan • Cluster and Grid Research in TITECH, GSIC • Kyoto University, Japan • High Performance Application on the Grid • Monash University, Australia • Queensland University of Technology, Australia • Active Sheets and Gardens 2 • KISTI, Korea • Supercomputing and Grid activities in KISTI • Kasetsart University, Thailand • Thai Grid • NCHC, Taiwan had their own booth.

  7. SC Global Panel • Title: Can the Asia Pacific Grid contribute to Sci. & Tech. in Asia Pacific Region? • 6 panelists from AU, JP, KR, TH, TW, US • Connected Denver, AIST/Japan, Sydney VisLab/Australia via the Access Grid

  8. ApGrid core meeting 2002 WELCOME to Phuket Laguna Beach Resort Hotel Laguna, PhuketJan 25-26, 2002 Special Thanks to Dr. Sissades Tongsima Dr. Piyawut Srichaikul

  9. Agenda of this meeting • Discussion on drafting the structure of this community and membership • Discussion on “how to build the testbed” • Discussion on guide lines how to donate computing resources and how to configure them for interoperability awareness • Report the status of current ApGrid nodes. • Selection for the next ApGrid Workshop in 2002 • CALL: other issues

  10. ApGrid Testbed • Experimental Testbed • Have experience and knowledge on running VO • Evaluation of Grid systems • Running Applications • Donation (Contribution) based

  11. Possible ApGrid Nodes • PC Clusters • 64cpu Linux cluster (AIST, Japan) • 64cpu Linux cluster (TITECH, Japan) • 216cpu Linux cluster (Osaka U., Japan) • 8cpu Linux cluster (Tsukuba U., Japan) • 8cpu Linux cluster (Doshisha U., Japan) • 8cpu Linux cluster (RIKEN, Japan) • 32cpu Linux cluster (NCHC, Taiwan) • 20cpu Linux cluster (NTU, Singapore) • 14cpu Linux cluster (NUS, Singapore) • 16cpu Linux cluster (KU, Thailand) • 10cpu Linux cluster (KMIT, Thailand) • 16cpu Sun UE Cluster (AIST, Japan) • And more… • Supercomputers • NEC SX-6i (RIKEN, Japan) • Cray SV1 (AIST, Japan) • SGI Origin 3200 (NUS, Singapore) • Cray SV1 (NUS, Singapore)

  12. Testbed Developments • Security Infrastructure • Based on GSI • The ApGrid Testbed runs CAs and issues certificates for users and resources. • The ApGrid Testbed allows multiple root CAs. • Each country/organization/project could run its own CA and these could be root CAs on the ApGrid Testbed. • The ApGrid Testbed is also planning to run an ApGrid root CA which is signed by a commercial CA such as Verisign.

  13. Testbed Developments (contd) • Information Services • Based on GRIS/GIIS • GrADS could be a good example

  14. Testbed Developments Summary • Globus Toolkit is used as a common software infrastructure on the ApGrid Testbed • Globus Toolkit provides GSI, GRIS and GIIS • Defacto standard of the low-level Grid middleware • Provides better interoperability with other Grid testbeds

  15. Resource Donation Guideline • Required Software • Globus Toolkit should be installed on every donated resource. • Following information should be provided via GRIS/GIIS • Host specific information (hostname, hardware architecture, etc.) • Installed software (name, version, install directory, etc.) • Detailed information could be better support for users. • Announcements • When the resource becomes ready, send an email to the appropriate MLs. • Create login accounts • Every user should be appropriately authenticated. • Every user should provide his/her user certificate signed by a trusted CA. • Maintenance • Donated resources should be monitored appropriately.

  16. Other issues • Administrative work • DNS domain (apgrid.org) • Mailing list (core@apgrid.org,info@apgrid.org) • Home Page (www.apgrid.org) • Technical issues • Cluster utilization on the Grid • Most contributed resources are cluster systems. • Supposed problems: • private IP address handling, MPICH-G2, etc. • Standardization required? -> Cluster BOF, Yesterday

  17. Applications and Portals ActiveSheet, BioGrid, Drug Design, HEPGrid, ThaiGrid Portal, CFD, Environmental and Ecology Preservation,… High Level Grid Middleware Programming Tools: Ninf, Nimrod DPL, MetaCompiler Simulators: Bricks and GridSim Resource Brokers: Nimrod-G Low Level Grid Middleware Security, Process, Storage, QoS, etc: Globus, Jxta, CPM, GrACE, Gridfarm Grid Fabric AP partners have Computers: PC, WS, Clusters, Supercomputers; SCE manager; WAN: Internet, APAN, GrangeNet; Instruments: KEK Accelerators, … Collaboration on the ApGrid

  18. GrangeNet Rolein Advanced Networks Global GRID Forum Canarie China APGrid StarTap Korea Japan Internet2 Europe APAN Dante South America Singapore Connection to other National Advanced Networks and Testbeds Cooperation with other national and major organisations in advanced communications and grid services GrangeNet South Asia Middle East Europe AARNet This slide by courtesy of John O’Callaghan@APAC

  19. Nimrod/G and Grid Economy“A Market Paradigm for Distributed Resource Management and Scheduling” Rajkumar Buyya, David Abramson, Jon Giddy Monash University, Melbourne, Australia www.buyya.com/ecogrid www.gridcomputing.com

  20. Nimrod/G : A Grid Resource Broker • A resource broker for managing and steering task farming (parametric sweep) applications on computational Grids based on deadline and computational economy. • Key Features • A single window to manage & control experiment • Resource Discovery • Trade for Resources • Resource Composition & Scheduling • Steering & data management • It allows to study the behaviour of some of the output variables against a range of different input scenarios.

  21. BioMed Grid Task Force Task Force set up for forward planning and coordinating implementation of IT infrastructure for the Biopolis and beyond, Technical Committees include • HPC & Storage • Communications • Security • Software • User needs and training This slide by courtesy of Lawrence WC Wong@NUS

  22. NUS BioGRID Architecture http://www.bic.nus.edu.sg/biogrid CRAY SV1 – 8 x CPUs GRID Host SGI 3200 Irix GRID Host Linux – P-III 800MHz GRID Host/GIIS/MDS Sun UltraSPARC Solaris GRID Host Linux cluster – 14xP-III 800MHz GRID Host (Sun GridEngine) This slide by courtesy of Tan Tin Wee & Ong Guan Sin@NUS

  23. Grid Forum Korea(GFK) History 2002 2001. 3 5 6 8 10 7 9 GGF1(KISTI) Start N*Grid Euro-Globus Workshop(MIC, KISTI) GGF2(KISTI, N*Grid, GFK) GFK Committee Asia-Pacific Grid Implementation Project(APEC TEL) GGF3(KISTI, TEIN) ApGrid(KISTI, N*Grid, APEC TEL) GFK1 (2001. 10) Second GFK & Second PRAGMA meeting (2002. 7) http://www.gridforumkorea.org This slide by courtesy of Jysoo Lee @ KISTI

  24. On Going Projects in Thailand • Developing application middleware for data intensive applications e.g., • bioinformatics, • geoinformatics. • Sponsoring Grid activities in Thailand • High speed connection for ThaiGrid activities This slide by courtesy of Sissades Tongshima@NECTEC

  25. Planned Grid Activities in Taiwan GeoGrid [NCHC] : Support Hazard mitigation and governmental decision making:Integrate Digitized GIS data, satellite image, city planning, earth quake data, flooding data etc. Metacomputing[NCHC] : • Work with HLRS, SCAI, PTS, U. Kentucky, iHPC. NDAP-Grid[ASCC] : DataGrid for National Digital Archives Project BioGrid, Taiwan[ASCC] Focus: Bio-informatic computing and databases Participation in Eu DataGrid [ASCC] Focus: Country Member of Eu DataGrid for High Energy Physics This slide by courtesy of Fang Pang Lin @ NCHC

  26. Summary of Grid Projects in Malaysia This slide by courtesy of Fazilah Haron @ USM

  27. PRAGMA – Focus on Applications • PRAGMA = Application consortium • What are the applications? • What do the applications need? • How do we make it happen? • Advisory for resource centers and testbeds • Provide structure for discussion (not just PI-to-PI) • Formalize an exchange program of scientists and scholars • Collaborate with and support existing Grid technology activities, such as Global Grid Forum (GGF), Asia Pacific Grid (APGrid), Asia Pacific Advanced Network (APAN) This slide by courtesy of Henri Casanova @ SDSC

  28. Grid Computing using Ninf-G • Ninf-G is a Grid RPC system on the Globus Toolkit. • A simple RPC-based programming model for the Grid • Key property: EASE OF USE, Easy going • Grid-RPC is under standardization process in GGF • Deploy Ninf-G on the ApGrid Testbed and have knowledge, experience, and feedback • Develop real application programs using Ninf-G • ApGrid (and other) Portals using Ninf-G

  29. Data Mining Structural Optimization Vehicle Routing Problem High Performance Grid Computing for optimization problems using Ninf-G • Prof. Fujisawa @ Kyoto Univ.(SC2001) • Combinatorial Optimization Problems • Nonlinear Optimization Problems Slide by courtesy of Prof. Fujisawa

  30. Summary • ApGrid focuses on • Sharing resources, knowledge, technologies • Developing Grid technologies • Helping the use of our technologies in create new applications • Collaboration on each others work • We should accelerate the testbed developments. • We could have good experience on running REAL international virtual organization. • Technical Issue, Policy Issue, etc.

  31. For more info ApGrid Home Page www.apgrid.org ApGrid Core ML core@apgrid.org

More Related