1 / 14

Advanced Computing and Grid Infrastructure in Australia

ISGC 2005 26-29 April 2005 Taiwan. Advanced Computing and Grid Infrastructure in Australia. John O’Callaghan Executive Director Australian Partnership for Advanced Computing www.apac.edu.au. Australian Partnership for Advanced Computing. “providing advanced computing and

guri
Download Presentation

Advanced Computing and Grid Infrastructure in Australia

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ISGC 2005 26-29 April 2005 Taiwan Advanced Computing and Grid Infrastructure in Australia John O’Callaghan Executive Director Australian Partnership for Advanced Computing www.apac.edu.au

  2. Australian Partnership forAdvanced Computing “providing advanced computing and grid infrastructure for e-Research” Partners: • Australian Centre for Advanced Computing and Communications (ac3) in NSW • CSIRO • Queensland Parallel Supercomputing Foundation (QPSF) • Interactive Virtual Environments Centre (IVEC) in WA • South Australian Partnership for Advanced Computing (SAPAC) • The Australian National University (ANU) • The University of Tasmania (TPAC) • Victorian Partnership for Advanced Computing (VPAC)

  3. APAC National Facility • Usage • mainly biology, chemistry, physics • currently 247 projects and 722 users (27 universities) • Computing Systems • SGI Altix 3700 Bx2 system (mid-2005) • 1680 processors • HP AlphaServer SC ES45 • 508 processors • Dell Linux cluster • 150 processors • Mass Data Storage System (MDSS) • Hierarchical Storage Management • SAM-FS • Storagetek (robotic silo) tape library • Capable of a petabyte (1015 bytes) of storage • Visualisation Systems • Virtual reality systems • Access Grid rooms • Staff • User support • Systems support • Computational tools and techniques • Large-scale data collection management http://nf.apac.edu.au

  4. APAC National Grid • allow easier access to APAC facilities • one virtual system of computational facilities • single ‘sign-on’ to the computing systems • portals and workflow to access applications software and data • secure infrastructure • authorisation, authentication, accounting • support participation in international programs • compatibility with grids in other countries • significant human resource investment • involves about 100 people • started in 2004…….

  5. APAC Grid Interfaces Research Teams Data Centres QPSF AC3 IVEC Sensor Networks APAC NATIONAL FACILITY ANU SAPAC CSIRO TPAC VPAC Other Grids: Institutional National International Instruments

  6. Context of APAC Grid Astronomy Grids HEP Grids Bio-Grids Earth Systems Grids Geosciences Grids APAC National Grid Infrastructure International Infrastructure Institutional Infrastructure

  7. Australia is well-connected

  8. APAC Grid Infrastructure • Computing Infrastructure • APAC certificate authority • VDT middleware (Globus) • meta-scheduling (PBS-based) • system monitoring and management • job distribution for parameter searches (NIMROD/G) • Information Infrastructure • storage resource broker (SRB) • metadata management support (XML-based) • resource discovery • User Interfaces and Visualisation Infrastructure • Gridsphere-based portals • workflow engines • collaborative visualisation tools (RVS,…)

  9. APAC GridApplication Projects • High-Energy Physics • Astronomy • Earth Systems Science • Computational Chemistry • Bioinformatics • Geosciences

  10. APAC Grid Experimental High-Energy Physics • Belle Experiment • K.E.K. B-factory • Australian grid for Belle data • exploiting Globus 2.x, SRB • data grid based at APAC National Facility • move to APAC Grid infrastructure • Atlas Experiment • Large Hadron Collider (LHC) at CERN • Deployed LCG toolkit, will follow EGEE • Plan for Tier 2 facility in Australia • more in Glenn Moloney’s talk tomorrow…..

  11. APAC Grid Astronomy • MACHO Project • Largest on-line astrophysical data set in Australia • ~10TB Data collected over ~10 years • Hosted on APAC MDSS and part of IVO collection • Currently using Z39.50 metadata standard • Mapping metadata to VOTable 1.0 standard • Emerging IVO metadata standard • wwwmacho.anu.edu.au • Australian Virtual Observatory • efficient, uniform access to key astronomical data collections • 2dFGRS, HIPASS, ATCA-OA, SUMSS, MACHO, TNO, ROTSE-III, WFI, S4, … • www.aus-vo.org • International Virtual Observatory • SIAP service for ATCA Phoenix Deep Field Survey (PDFS) • SIAP is an International Virtual Observatory Alliance (IVOA) access protocol • www.ivoa.net

  12. APAC Grid Earth Systems Science • Data Products • CSIRO Inter-governmental Panel Climate Change scenarios (3Tb) • Ocean Colour Products of Australasian and Antarctic region • MODIS and SeaWIFS (10Tb) • TPAC 1/8 degree ocean simulations (2-4Tb) • BMRC research products (~1-4Tb) • ACE CRC Earth Systems Simulations • Terrestrial Land Surface Data • Grid Services • Globus based version of OPeNDAP • analysis tools for OPeNDAP data sets • GRADS OPeNDAP server, NOMADS • Client side visualisation from OPeNDAP servers • THREDDS (catalogues of OPeNDAP repositories) http://www.opendap.org/

  13. APAC Grid Chemistry • Portal to chemistry software packages • Gridsphere-based portal to APAC Grid • Gaussian, Amber, Gamess-US, Gromacs, Mopac and Molpro Firewall Web Server HTTPS Globus Gridsphere Portal Grid Computers

  14. APAC Grid Architecture PORTALS WORKFLOW APPLICATION GRID MIDDLEWARE ? GENERIC GRID MIDDLEWARE SECURITY COMPUTING, STORAGE, VISUALISATION SYSTEMS NETWORKS

More Related