European Network Policy Group Malcolm Atkinson Director nesc.ac.uk 28 th October 2004

1. European Network Policy GroupMalcolm AtkinsonDirectorwww.nesc.ac.uk28th October 2004

2. Outline • The UK e-Science Programme • Funding and organisation • The UK Grid • Example Projects and Middleware • OGSA-DAI • Biomedical applications Building e-Infrastructure: People, sociological, economic & technical challenges One e-Infrastructure: for all disciplines – they all need it. Balance application pull and organised delivery + Engage industry. International collaboration on building e-Infrastructure essential. All disciplines and commercial sectors will join in.

3. What is e-Science? • Goal: to enable better research in all applications • Method: Invention and exploitation of advanced computational methods • to generate, curate and analyse research data • From experiments, observations and simulations • Quality management, preservation and reliable evidence • to develop and explore models and simulations • Computation and data at extreme scales • Trustworthy, economic, timely and relevant results • to enable dynamic distributed virtual organisations • Facilitating collaboration with information and resource sharing • Security, reliability, accountability, manageability and agility Does e-Science imply new European requirements?

4. The Primary Requirement … Enabling People to Work Together on Challenging Projects: Science, Engineering & Medicine

5. EPSRC Breakdown + Industrial Contributions £25M UK e-Science Budget (2001-2006) + £100M via JISC Total: £213M Staff costs - Grid Resources Computers & Network funded separately Source: Science Budget 2003/4 – 2005/6, DTI(OST)

6. Globus Alliance Digital Curation Centre The e-Science Centres e-Science Institute NationalCentre fore-SocialScience Grid Operations Support Centre Open Middleware Infrastructure Institute National Institute for Environmentale-Science CeSC (Cambridge) EGEE

7. 1600 x CPU AIX 512 x CPU Irix HPC(x) 20 x CPU 18TB Disk Linux 64 x CPU 4TB Disk Linux The e-ScienceGrid Engineering Task Force (Contributions from e-Science Centres) Grid Support Centre / Grid Operations Centre OGSA Test Grid projects Architecture Task Force Security Task Force Usability Task Force CeSC (Cambridge)

8. The European dimension • EGEE: Enabling Grids for E-Science in Europe • … and beyond • 32M Euro, 10 regions, 70 partners • Additional funding from NSF (USA) • 50% production, 30% development, and 20% dissemination and training • “The Grid Infrastructure in Europe” • Deploy a production Grid across Europe • Initially based on LHC Computing Grid UK NGS will converge and run same e-Infrastructure

9. Importance of collaboration: VDT • A highly successful collaborative effort • VDT Working Group • VDS (Chimera/Pegasus) team • Provides the “V” in VDT • Condor Team • Globus Alliance • NMI Build and Test team • EDG/LCG/EGEE • Middleware, testing, patches, feedback … • PPDG • Hardening and testing • Pacman • Provides easy installation capability • Currently Pacman 2, moving to Pacman 3 soon Used by many projects Systematic testing Rich integration of components Europe should be part of this – exploit test bedcontribute componentsProductise our M/W with this testing & packaging Thanks to Miron Livny

10. Where Next for e-Infrastructure • Put people and teams first • Invest in building a community • The creative force • The repository of Experience, Skills and Knowledge • Focus on Major Priorities • Developing well-defined Flexible Agreements • Embraced as standards • High-level Software Investment • Applications & Requirements led • Explore & Evolve Common & Shared Infrastructure • Recognise and respond to differences • Celebrate and support commonalities • International Collaboration Essential • Global Research • Standards and interoperation

11. Outline • The UK e-Science Programme • Funding and organisation • The UK Grid • Example Projects and Middleware • OGSA-DAI • Biomedical applications Building e-Infrastructure: People, sociological, economic & technical challenges One e-Infrastructure: for all disciplines – they all need it. Balance application pull and organised delivery + Engage industry. International collaboration on building e-Infrastructure essential. All disciplines and commercial sectors will join in.

12. Job Submission Brokering Workflow Structured Data Integration Registry Banking Authorisation Data Transport Resource Usage Transformation Structured Data Access Structured Data Relational XML Semi-structured - Infrastructure Architecture Data Intensive X Scientists Data Intensive Applications for Science X Simulation, Analysis & Integration Technology for Science X Generic Virtual Data Access and Integration Layer OGSA OGSA-DAI Grid or Web Service Infrastructure Compute, Data & Storage Resources Distributed Virtual Integration Architecture

13. Downloads by Country – OGSA-DAI R4.0 Taiwan France 2% 3% Australia 2% Austria United Kingdom 2% 21% Italy 5% Germany 5% China Unknown 26% 7% Japan United States 5% 13% OGSA-DAI Downloads R4 • 690 downloads since May 04 • Actual user downloads not search engine crawlers • -Does not include downloads as part of GT3.2 releases • Total of 838 registered users • R1.0 (Jan 03) 104 • R1.5 (Feb 03) 108 • R2.0 (Apr 03) 250 • R2.5 (Jun 03) 291 • R3.0 (Jul 03) 792 • R3.1 (Feb 04) 630 • Total 2865

14. Database Growth PDB Content Growth

15. Glasgow Edinburgh Leicester Oxford Netherlands London Wellcome Trust: Cardiovascular Functional Genomics Public curateddata Shared data BRIDGES IBM

16. Biochemical Pathway Simulator • (Computing Science, Bioinformatics, Beatson Cancer Research Labs) • DTI Bioscience BeaconProject • Harnessing Genomics Programme Walter Kolch Now largest EU project in the Life Sciences – see http://www.cancerresearchuk.org/news/pressreleases/scottishscientists_22july04 Slide from Muffy Calder, Glasgow

17. eDiaMoND – Compute Mammograms have different appearances, depending on image settings and acquisition systems Temporal mammography Computer Aided Detection Standard Mammo Format 3D View Provided by eDiamond project: Prof. sir Mike Brady et al.

18. Automatic registration technology Rigid registration of MR and CT images of the head Inter-subject image warping Provided by IXI project: Prof. Derek Hill et al.

19. e-Science Institute Figures for 3 Years We have run just under 7 per month (up from just over 6 at last Review) • 19,456 delegate days • 248 events • 8,329 delegates (many ‘repeats’) • 421 event days (in  750 working days) • Further statistics exclude GGF5, as we did not handle registration so cannot do a detailed analysis.

20. Events held in the 3rd Year(from 1 Aug 2003 to 31 Jul 2004) We had 114 (86,48) events: (Year 2 & 1 figures in brackets) • 7 project meetings ( 11, 4) • 8 research meetings ( 11, 7) • 34 workshops (25, 18) • 2 schools (2, 0) • 18 training sessions (15, 8) • 26 outreach events (12, 3) • 6 international meetings (5,1) • 4 conferences (0,1) • 9 e-Science management meetings (5, 7)

21. Attendance from different countries Involvement in EGEE reflected in increase in EU participation

22. Take home messages • E-Science is for everybody & every discipline • Environment, health, safety, design, science, humanities • To enable it • Build “people grids” • And “institution e-Infrastructures” • The Technology • Will support useful work now • But still too hard to use & hard to sustain • Work on the Technology • Middleware, Portals, Security, Networks collaboratively