1 / 17

FutureGrid

FutureGrid. Cyberinfrastructure for Computational Research. FutureGrid Goals. An environment that can be used for middleware developers to develop and test middleware

saville
Download Presentation

FutureGrid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FutureGrid Cyberinfrastructure for Computational Research

  2. FutureGrid Goals An environment that can be used for middleware developers to develop and test middleware An environment that can instantiate a wide variety of computing environments (ranging from current TeraGrid software, VMs, cloud, grid systems other than TG) for development and testing of applications on experimental basis in a test bed, in replicable ways Education related to all of the above US Industry research related to the above

  3. FutureGrid Components Compute – flexible deployment of images, VM's, clouds Storage – local storage sufficient to facilitate projects, Lustre for larger projects Network – Dedicated networks between FutureGrid sites, Impairment Device

  4. Compute Hardware

  5. Storage Hardware • FutureGrid has a dedicated network (except to TACC) and a network fault and delay generator • Experiments can be isolated by request • Additional partner machines may run FutureGrid software and be supported (but allocated in specialized ways)

  6. Logical Network Diagram

  7. Network Impairments Device • Spirent XGEM Network Impairments Simulator for jitter, errors, delay, etc • Full Bidirectional 10G w/64 byte packets • up to 15 seconds introduced delay (in 16ns increments) • 0-100% introduced packet loss in .0001% increments • Packet manipulation in first 2000 bytes • up to 16k frame size • TCL for scripting, HTML for manual configuration

  8. http://futuregrid.org

  9. FutureGrid Architecture • Open Architecture allows to configure resources based on images • Managed images allows to create similar experiment environments • Experiment management allows reproducible activities • Through our modular design we allow different clouds and images to be “rained” upon hardware. • Will support deployment of preconfigured middleware including TeraGrid stack, Condor, BOINC, gLite, Unicore, Genesis II

  10. Software Goals • Open-source, integrated suite of software to • instantiate and execute grid and cloud experiments. • perform an experiment • collect the results • tools for instantiating a test environment • TORQUE, Moab, xCAT, bcfg, and Pegasus, Inca, ViNE, a number of other tools from our partners and the open source community • Portal for interacting with tools • Benchmarking 08/25/10 http://futuregrid.org 10

  11. Draft GUI for FutureGrid Dynamic Provisioning

  12. Command line • fg-deploy-image • host name • image name • start time • end time • label name • fg-add • label name • framework hadoop • version 1.0 • Deploys an image on a host • Adds a feature to a deployed image 08/25/10 http://futuregrid.org 12

  13. FG Stratosphere • Objective • Higher than a particular cloud • Provides all mechanisms to provision a cloud on a given FG hardware • Allows the management of reproducible experiments • Allows monitoring of the environment and the results • Risks • Lots of software • Possible multiple path to do the same thing • Good news • We worked in a team, know about different solutions and have identified a very good plan • We can componentize Stratosphere 08/25/10 http://futuregrid.org 13

  14. Dynamic Provisioning • Change underlying system to support current user demands • Linux, Windows, Xen/KVM, Nimbus, Eucalyptus • Stateless images • Shorter boot times • Easier to maintain • Stateful installs • Windows • Use Moab to trigger changes and xCAT to manage installs 08/25/10 http://futuregrid.org 14

  15. Experiment Manager • Objective • Manage the provisioning for reproducible experiments • Coordinate workflow of experiments • Share workflow and experiment images • Minimize space through reuse 08/25/10 http://futuregrid.org 15

  16. Getting started with FutureGrid www.futuregrid.org Account/Project request Nimbus/Eucalyptus account for those systems, if needed Getting started information at www.futuregrid.org/tutorials Mail help@futuregrid.org for any issues

  17. Acknowledgements • FutureGrid - http://www.futuregrid.org/ • NSF Award OCI-0910812 • NSF Solicitation 08-573 • http://www.nsf.gov/pubs/2008/nsf08573/nsf08573.htm • ViNe - http://vine.acis.ufl.edu/ • Nimbus - http://www.nimbusproject.org/ • Eucalyptus - http://www.eucalyptus.com/ • VAMPIR - http://www.vampir.eu/ • Pegasus - http://pegasus.isi.edu/

More Related