1 / 48

EGI/ EGI.eu , EGI-InSPIRE and NGI-HU

EGI/ EGI.eu , EGI-InSPIRE and NGI-HU. Agnes Szeberenyi SZTAKI LPDS Based on EGI-InSPIRE Project Presentation May 2012. Outline. EGI Overview EGI-InSPIRE project Fun stuff Hungarian National Grid Initiative. EGI. E uropean Over 35 countries G rid Secure sharing Collaboration

nitza
Download Presentation

EGI/ EGI.eu , EGI-InSPIRE and NGI-HU

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. EGI/EGI.eu, EGI-InSPIRE and NGI-HU AgnesSzeberenyi SZTAKI LPDS BasedonEGI-InSPIRE Project Presentation May 2012 SummerSchool 2012, Budapest

  2. Outline • EGI Overview • EGI-InSPIRE project • Funstuff • Hungarian National GridInitiative

  3. EGI • European • Over 35 countries • Grid • Secure sharing • Collaboration • Infrastructure • Computers • Data • Instruments • …. and beyond!! Project Presentation – May 2012

  4. What is EGI? • European Grid Infrastructure (EGI) • Federation of National Grid Infrastructures • Represented by EGI.eu (Dutch foundation) • National Grid Infrastructures (NGIs) • Sole national point of contact for Grids and Clouds • Integrates individual resource centres • Current Status: • 35+ NGIs & 350+ resource centres • 300,000 CPUs & 200PB+ storage Project Presentation – May 2012

  5. EGI Resource Infrastructure Providers - RPs(April 2012) Project Presentation – May 2012

  6. EGI Resource Centres(April 2012) Project Presentation – May 2012

  7. Vision - Mission • To support the digital European Research Area through a pan-European research infrastructure based on an open federation of reliable services that provide uniform access to national computing, storage and data resources. • To connect researchers from all disciplines with the reliable and innovative ICT services they need to undertake their collaborative world-class and world-spanning research Project Presentation – May 2012

  8. Summary • EGI.eu established in Amsterdam • Supported through EGI-InSPIRE project and later others (e-Fiscal) • EGI has transitioned from a federation of regional to national resource providers • EGI works with technology providers on an open standards based architecture • EGI is evolving to support the needs of its current and new research communities Project Presentation – May 2012

  9. Metrics (April 2012) Project Presentation – May 2012

  10. VO Statistics (April 2012) Supported Research Communities • Archeology • Astronomy • Astrophysics • Civil Protection • Comp. Chemistry • Earth Sciences • Finance • Fusion • Geophysics • High Energy Physics • Life Sciences • Multimedia • Material Sciences • … Project Presentation – May 2012

  11. EGI means Innovation • Deploy Technology Innovation • Distributed Computing continues to evolve • To include: Grids, Desktops, Virtualisation, Clouds, … • Enable Software Innovation • Provide reliable persistent technology platform • Tools built on gLite/UNICORE/ARC/Globus • Support Research Innovation • Infrastructure for data driven research • Support for international research (e.g. ESFRI) Project Presentation – May 2012

  12. Technology Innovation • Will come from outside EGI • Moving research technologies into production • Partnership with technology projects • EMI (European Middleware Initiative) • IGE (Initiative for Globus in Europe) • EDGI (European Desktop Grid Initiative) • StratusLab • VenusC • SAGA Project Presentation – May 2012

  13. Software Innovation • Will also come from outside EGI • EGI is a neutral platform for applications • EGI cannot support all services for all users • Every community needs something different • Foster innovation within different ‘sectors’ • e.g. Digital Libraries • gCube from D4Science Project Presentation – May 2012

  14. Research Innovation • An infrastructure to support European Researchers • Within the EU27 • Geographical Europe • Worldwide Interoperability • Work with Virtual Research Communities • Groupings of aligned Virtual Organisations • Enable their community specific support activity: • Support, training, consultancy, requirements etc. Project Presentation – May 2012

  15. EGI’s Strategic Focusin 2020 • Community & Coordination • Community building through events • Community networking through the NGIs • Operational Infrastructure • Operate a European wide infrastructure • Offer its use to other research infrastructures • Build a federated cloud environment • Virtual Research Environments • Enable 3rd party integration & operation of VREs http://go.egi.eu/EGI2020 Project Presentation – May 2012

  16. Enabling Platforms • Core Infrastructure Platform • Used by EGI to run distributed services • Available for other Research Infrastructures • Collaborative Infrastructure Platform • Services to enable collaboration between • EGI and its supported Research Communities • Research Communities and each other • Cloud Infrastructure Platform • Prototype federation of distributed private clouds • Enable the deployment of VREs on demand Project Presentation – May 2012

  17. Core Infrastructure Platform • Services needed to provide an integrated reliable uniform federated service infrastructure • Monitoring & Accounting • Helpdesk & Oversight Project Presentation – May 2012

  18. Collaborative Infrastructure Platform • Services to enable collaboration between researchers and research communities • Helpdesk, Software Repository • AppDB, Training Marketplace, VMI Marketplace • Group management (VOMS & Federated ID) • Partnerships for other e-Science services Project Presentation – May 2012

  19. Cloud Infrastructure Platform • Services to enable research communities to run their VREs when and where they want to • Federated to provided a uniform infrastructure • VM Image Marketplace to share & use • Prototype testbed under development Project Presentation – May 2012

  20. User Support & Services • Support User Communities • Researchers in International Collaborations • National Research Collaborations through the NGI • Scale up from the single VO to a community • Provide core services to support users • Manage VOs, AppDB, Training Services • Support teams • EGI.eu User Community Support Team • NGI User Support Teams • NGI Operations Teams • Experts within user communities or projects Project Presentation – May 2012

  21. EGI-InSPIRE Project Project Presentation – May 2012

  22. EGI-InSPIRE Project EGI and EGI.euare supportedby the EGI-InSPIRE project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe A 4 year project with €25M EC contribution • Project cost €72M • Total Effort ~€330M • Effort: 9261PMs Project Partners (50) EGI.eu, 38 NGIs, 2 EIROs Asia Pacific (9 partners) Project Presentation – May 2012

  23. Project Objectives • A sustainable production infrastructure • With resource providers around the worldwide • With new technologies as they mature • Support structured international research • Sustain current domain specific services • Attract new research communities (e.g. ESFRI) Project Presentation – May 2012

  24. Useful links • http://www.egi.eu/ • EGI Technical Forum 2012 http://tf2012.egi.eu/ • http://www.egi.eu/services/support/applications_database/ • http://www.egi.eu/services/support/training_marketplace/ • http://www.egi.eu/services/support/science-gateways/ Project Presentation – May 2012

  25. Funstuff Project Presentation – May 2012

  26. eScienceTalk • ISGTWnewsletter 8,000 subscribers, 196 countries, sharingsuccessstories of e-science and technology http://www.isgtw.org/ • eScience City  designedas a city toexploregrid/volunteer/cloud/HPC computing http://www.e-sciencecity.org/ • GridCast behindthescenes of events http://gridcast.org/ • GridGuide human facetogridcomputingwho/what/where/why of gridsites www.gridguide.org • GridCafe introductiontogridcomputing www.gridcafe.org • Real Time Monitor  realtimetrafficrunningongridaroundtheworld (3D interactiveglobe) http://rtm.hep.ph.ic.ac.uk/ • CaseStudies howgrodcomputing is helping scientists1 work http://www.egi.eu/case-studies/ • StoriesfromtheGrid successstoriespresentedinYouTubevideos http://www.youtube.com/europeangrid Project Presentation – May 2012

  27. Additional slides For further reading Project Presentation – May 2012

  28. Grid Use Cases These case studies show some of the advantages of using the grid: • allows world-wide multi-disciplinary collaboration; • integrate distributed resources into a single whole; • customised grid services to meet the unique demands of researchers; • reliable service for computation, data transfer and storage of large data sets; • reduced analysis time and analysis on-demand; • scientifically useful results are generated more quickly; • long term support; • sharing sensitive data securely among a trusted community; • allows member institutions to contribute computing power to the community; • generate data-intensive stimulations in a shorter amount of time; • reduce technical workload (by following grid standards), so scientists can concentrate more effort on the science Project Presentation – May 2012 30/05/2011 Project Presentation - May 2011

  29. Use Case: Large Hadron Collider • World’s largest particle accelerator • Supports 8,000 researchers • 1 billion CPU hours in the last 12 months • 15Pb of data created annually • Data ‘parked’ for later analysis Project Presentation – May 2012

  30. Use Case: Large Hadron Collider Some advantages of using the grid: • allows worldwide mass collaboration with thousands of physicists; • customisedgrid services to meet the unique demands of the experiments; • large data storage facility; • physicists can access the data using their own computer locally. Project Presentation – May 2012

  31. Use Case: New viruses • VIDISCA-454, new method to find new viruses from genetic material • Runs on grid computing thanks to customised workflows, allowing researchers to save time. • E.g. a test with 1444 samples produced 4,783,684 genetic sequences and was analysed in 14 hours. (Local server would need 17 days) • The method was used to identify a new type of coronavirus • Results published in Nature Medicine Many children suffer from respiratory diseases caused by unknown viruses http://go.egi.eu/virus Project Presentation – May 2012

  32. Use Case: The epigonion • The epigonion was the guitar of Ancient Greece – how did it sound? • DomenicoVincinanza recreated the sound of its 48 strings as digital files, using the grid-enabled ASTRA platform • It took him just a few hours - in a single core he would need a month. • The epigonion’s sounds can now be downloaded and played by any musician using a simple keyboard. Stories from the Grid, episode 2 The Epigonion (video) http://go.egi.eu/epigonion Project Presentation – May 2012

  33. Use Case: ITER • Investigating viability of fusion as a power source • Modelling and simulating the reactor • Used 1 million CPU hours in the last 12 months Project Presentation – May 2012

  34. Use Case: ITER Some advantages of using the grid: • perform the intensive computations needed to test the feasibility of fusion power before building the reactor; • open to future development: dedicated project ‘EUPHORIA’ was set up to further push the limits of existing state-of-the-art computing resources. Project Presentation – May 2012

  35. Use Case: DECIDE • Diagnostic Enhancement of Confidence by an International Distributed Environment • Diagnostic tools for the medical community • Example: Their Statistical Parametric Mapping application can help doctors to diagnose Alzheimer’s disease in its early stages and track the progress of the symptoms over time Project Presentation – May 2012

  36. Use Case: DECIDE Some advantages of using the grid: • a single European-wide master database of images stored on the grid for doctors to use; • can set up diagnostic tools with a dedicated grid infrastructure; • customisable: dedicated software to track progression of the disease over time; • sharing medical data securely. Project Presentation – May 2012

  37. Use Case: Earthquakes • Earthquakes are caused by seismic waves that propagate as ripples on a pond • By studying how seismic waves travel it’s possible to predict how a site will respond to an earthquake • The Finite-Difference (FD) method simulates wave propagation by solving differential equations • But building one accurate model means solving millions of equations! • Grid computing allows scientists to solve the equations in parallel, saving time and resources. • The concept was applied in Thessaloniki, Greece. • The model helps local authorities to prepare the regional responseto earthquakes Earthquakes are not predictable, but their effects can be mitigated by modelling and planning http://go.egi.eu/thess Project Presentation – May 2012

  38. Use Case: CTA • The Cherenkov Telescope Array • Future ground-based high energy gamma-ray instrument • 132 institutes in 25 countries • Using applications and grid technology provided by the European grid Project Presentation – May 2012

  39. Use Case: CTA Some advantages of using the grid: • allows member institutions to contribute computing power to the CTA community; • generate data-intensive stimulations in a shorter amount of time; • reduce technical workload (by following grid standards), so scientists can concentrate more effort on the science. Project Presentation – May 2012

  40. Applications and user support for EGI communities by the Hungarian NGI http://ngi-hu.eu http://grid.kfki.hu/hungrid/

  41. Hungarian NGI ( NGI-HU)

  42. NA3 – EGI-InSPIRE EC Review 2011

  43. Hungrid VO I. • Motivation and aimin 2005: • Until 2005 Hungariangriduserswereonlyfrom HEP • Toextendusercommunities, todrawallHungarianparticipants • Toprovidecatch-all VO for non VO memberparticipants • Platform of 24/7 availability • Open toanyonefromtheHungarianacademic and educationalfield. 1st officialHungarianVirtualOrganization http://grid.kfki.hu/hungrid

  44. Hungrid VO II. • Twofoldgoal • Catch-allVO for all the Hungarian participants whoarenot part of any EGEE VO. • Provide EGEE testing and preparationenvironmentforprospectiveHungarianVos • Providedservices: • UserInterface, LCG File Catalogue, ComputingElement • Storage Element, BDII, Loggingand Bookkeepingservices • VOMS, WorkloadManagement System, MyProxy, MessagePassingInterface • Hungridportal

  45. Hungrid VO summary • Resourcesbymemberinstitutes: • Currently 82 users • ~ 10 activeuser

  46. Hungridsummary II. • Applicationareas; Notonlyfrom HEP: • Air pollutionforecastsimulations • Parityconservingtodirectedpercolation • Kardar-Parisi-Zhanggrowthonto a drivenlattice gas model of dimers • Morphology classes of convex bodies basedonstaticequilibria • Analysing the geometric sensitivity of truss • Medical visualization for PET, SPECT, CT and MRI devices

  47. NGI-HU Challenges • Small country • Smallusercommunity • Lack of governmentalsupport • Lack of contributionwithinthememberinstitutes

  48. Budapest University of Technology and Economics

More Related