1 / 37

Session 38 Friday 21 st July

Session 38 Friday 21 st July. Malcolm Atkinson, Roberto Barbera, Lisa Childers, Steven Newhouse, Oscar Corcho, Ron Perrott and Alain Roy. Final Panel: Future of Grids Addressing Scenarios. Introduction to Panel on Grids. Vision of Grid Future

jdenton
Download Presentation

Session 38 Friday 21 st July

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Session 38 Friday 21st July Malcolm Atkinson, Roberto Barbera, Lisa Childers,Steven Newhouse, Oscar Corcho, Ron Perrott andAlain Roy Ischia, Italy - 9-21 July 2006

  2. Final Panel: Future of Grids Addressing Scenarios Ischia, Italy - 9-21 July 2006

  3. Introduction to Panel on Grids • Vision of Grid Future • A Place for Today’s Systems in that Future? • Response to Scenario 1 • Response to Scenario 2 • Response to Scenario 3 Ischia, Italy - 9-21 July 2006

  4. The Summer School taught us what? • Collaboration is a challenge • Socio/economic issues • Technology relatively minor • Distributed systems are hard to build & run • Compromises & trade-offs find “sweet” spots • No one can satisfy all of the users all of the time • When you meet a technology • Find out what it is good for • Recognise what it can’t do • Vincent Breton’s Philosophy • Make the most of the current technology Ischia, Italy - 9-21 July 2006

  5. What grids will be in use in 5 to 10 years from now? Ischia, Italy - 9-21 July 2006

  6. Malcolm’s Answer • There will be a pervasive & 24*7 interconnected e-Infrastructure • It will use several underlying technologies • It will seamlessly link: • Major providers and curators of data / information • Who will provide some computation • Personal & group computing resources • Institutional resources • National & International HPC & HTC resources • All major facilities, e.g. Iter, LHC, Diamond, EBI, … • That will be the easy bit • It should mean that • Grids will be hidden & evolving • They will be taken for granted – as IP protocols & http are today Ischia, Italy - 9-21 July 2006

  7. Malcolm’s Answer 2 • People don’t pay for e-Infrastructure • They pay to run applications • Applications are made by developers • It is essential to attract them • And make them productive • Good APIs: abstractions & code mobility • Good tools: diagnostics, deployment, … • Easy to use & powerful components, links & services – the grid equivalent of libraries • Well-resourced user support: consulting, training, outreach, documentation, exemplars, community • This is the hard part! • If we don’t do it there wont be grids in the e-Infrastructure Ischia, Italy - 9-21 July 2006

  8. Other People's Answers What grids be in use in 5 to 10 years from now? Ischia, Italy - 9-21 July 2006

  9. Alain Roy’s Answer Ischia, Italy - 9-21 July 2006

  10. Roberto Barbera’s AnswerLet’s first start with a citation … Telephone, Light bulb, Telegraph, Radio, TV, Computer, Network, PC, Web, … (in the same order as they were invented) Ischia, Italy - 9-21 July 2006

  11. Now the Roberto Barbera’s Answer • The success of the grid in the next 5-10 years will not be decided by the fact that “killer” applications can run on it but, on the contrary,…. • By the fact that e-Infrastructures become pervasive, “transparent”, and we can use them as we today use TV’s and/or cellular phones; • By the general consensus, reached at all levels (social, academic, political, industrial, etc.), that a key enabler of Progress is e-Science. From hardware to middleware to software….to brainware. • I’m convinced that what we are doing here, and with your help, we will surely get there! Ischia, Italy - 9-21 July 2006

  12. Lisa Childer’s Answer Ischia, Italy - 9-21 July 2006

  13. Steven Newhouse’s answer • Pervasive, Invisible & Sustained fabric • Arrive as Web n.0 rather than Grid m.0 • It WILL be standards based • Local isolated standards just cause grief e.g. European mobile phones in Japan • Grid Programming Easier As Programming Easier • ‘Standard’ libraries composed into your application as run-time • Still CS research needed on dynamic composibility Ischia, Italy - 9-21 July 2006

  14. Oscar Corcho’s Answer • Grids that use semantic infrastructure with little user’s intervention (neither end users nor developers) • Service-Oriented Knowledge Utilities • Integrated in Grids as other “traditional” utilities • Addressing the following (non-exhaustive) issues • Trust and security in Virtual Organisations • What’s the best way to join a VO? Best may mean “cheaper”, “faster”, “less bureaucratic” • Higher level of abstraction in resource management • Easier resource discovery and composition • Appropriate management of distributed and incomplete information (and knowledge) • Including privacy and sensitivity issues • Human and societal issues • Costs and culture of knowledge capture, annotation, tagging, curation • Personalisation Ischia, Italy - 9-21 July 2006

  15. Devil’s advocate • Rationale, Foundation • CERN LHC; data storage; cost; • Other scenarios similar? • Which Applications? • Data and/or compute • Compute • Multicore – effort, challenges • FPGAs • HPC, Petascale 2011 • Clusters: Microsoft Ischia, Italy - 9-21 July 2006

  16. Issues • Software • Too difficult, complex • Many approaches, defects? • Is there time for standards? • Sequential applications • People • Career, interesting areas • Social, legal • Industry take up • EU criteria • What is success? • Grid grand challenge Ischia, Italy - 9-21 July 2006

  17. 5 – 10 years • Pure speculation after 3 years • Technology changes • In 5 years funding agencies etc. disillusioned • Little of benefit, banks • Community set back for a generation • Artificial Intelligence • Multidisciplinary wars • Blame game Ischia, Italy - 9-21 July 2006

  18. 15% ofcorporatesusing GSPs PriceWaterhouseCoopers Grid serviceproviders (GSP) IBM Gartner Foster & Kesselman critical internal useby largecorporates criticallyimportant “significantmomentum” Importanceto business technologymaturity science sectors science & non-science sectors harnessing computer cycles low/zero computing as a utility pervasive computing 2012 2000 2002 2004 2006 2008 2010 “Great GlobalGrid” “mature”, real deployments full revolution begins Take up of Grid Technologies i) production gridsfor research ii) vendors claim“100’s of corporategrid customers” TODAY Ischia, Italy - 9-21 July 2006

  19. Where is this all leading? e-Science and the Grid e-Business - Web/Grid Services Industrial Strength Infrastructure and Middleware e-Science Ischia, Italy - 9-21 July 2006

  20. Question 2: What is your technology good for? What doesn't it do? What will its role be in 5 to 10 years? Ischia, Italy - 9-21 July 2006

  21. The Condor Answer Ischia, Italy - 9-21 July 2006

  22. The OMII-UK Answer: Overview OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community • Documented web services and tools to access & share resources: • Data access & integration (OGSA-DAI) • JSDL based Job Submission (GridSAM) • UDDI based Registry (Grimoires) • WS-Eventing & Reliable Messaging (FINS & FIRMS) • Client-side environment & APIs – Jython (Geodise) • More components being commissioned & coming soon… Ischia, Italy - 9-21 July 2006

  23. The OMII-UK Answer: Capabilities • It is built from: • High-quality lightweight software components • These have been integrated, tested & documented. • It is easy to install and is supported. • It has not been designed for large-scale production grids • Some components may scale • But not currently our testing ‘sweet spot’ Ischia, Italy - 9-21 July 2006

  24. The OMII-UK Answer: The Future • Our goals are for a long-term future embedded in the e-Science community: • Build on widely supported industrial standards • Currently web services • Meet the needs of a broad community • End-users, developers, technologists, service providers • Commission and use what comes out of the community • Shared repository for code, projects, etc. • Work internationally to create that future • Schools, standards bodies, promotion, meetings, meetings, … • Act as the conduit between research and industry • Sustained future needs industrial providers after trailblazers • Join us – director@omii.ac.uk Ischia, Italy - 9-21 July 2006

  25. 20 sites in 3 continents The EGEE, gLite & GILDA answer gLite is far from being perfect and can/will surely be improved. However, the real strength of EGEE is its “global” approach to determine widely acceptable policies for setting up and operating large e-Infrastructures and to create the huge added value of the human networks running and using them. GILDA Ischia, Italy - 9-21 July 2006

  26. The Globus Answer Ischia, Italy - 9-21 July 2006

  27. The Semantic Grid Answer Ischia, Italy - 9-21 July 2006

  28. Scenario 1 Ischia, Italy - 9-21 July 2006

  29. Sketch of Scenario 1 • Suggested by Mark Thomas • Very Compute Intensive application with a Parametric Study Algorithm built in • Users run on their own machines • With long running times hogging the machines • Want to evolve the application to • A panel in existing GUI to select a grid option • Start grid use optionally after starting the application • Use existing corporate clusters behind scenes • Providing users with progress information • As grid resources are acquired • As parametric search progresses Ischia, Italy - 9-21 July 2006

  30. Sketch of Scenario 1 • Users must be able to • Close & re-open the application • With the search continuing or suspended • Collect and analyse final results • The users should never have to • Use a portal • Use a command line • 100KB input from client to start run • 10MB result set • Which M/W (maybe Grid) would you use? • How would it be used? • How would it be introduced? Ischia, Italy - 9-21 July 2006

  31. Scenario 2 Ischia, Italy - 9-21 July 2006

  32. Sketch of Scenario 2 • Suggested by Bill Pinnington • Perhaps abstract or a real challenge • Organisation A has 200 employees & 200 PCs • Uses a single SQL Server as a Data Warehouse • Jobs run every night • Repopulate data in database tables • Then build multi-dimensional models for next day • For decision support during the next day • Experiencing over-runs to mid morning • Scale of data and complexity increasing • Would a grid enable A to use the PCs to • Cope with current demand and its growth • If so, how should it be introduced? Ischia, Italy - 9-21 July 2006

  33. Scenario 3 Ischia, Italy - 9-21 July 2006

  34. Sketch of Scenario 3 • Marco Serra’s Suggestion • Italian Space Agency • Earth Observation • Seeking to • Improve Application Throughput & Response • Increase scalability • Link multiple data resources • Existing systems are heterogeneous Ischia, Italy - 9-21 July 2006

  35. Sketch of Scenario 3 • Existing applications are platform specific • Interoperation within agency & externally • Needed but doesn’t exist • Installing new H/W & S/W and then porting • Is not feasible • Will grids help • Reducing Application porting costs • Enabling data access and inter-operation? • If so, how? Ischia, Italy - 9-21 July 2006

  36. Ischia, Italy - 9-21 July 2006

  37. Other Questions or Break time Ischia, Italy - 9-21 July 2006

More Related