1 / 15

ScotGrid Procurement … a future news item

ScotGrid Procurement … a future news item. 25 June 2006: ScotGrid's 4th birthday June 25th marks the fourth anniversary of ScotGrid deployment. After four years, the system has provided more than 2 million CPU hours and 200,000 completed jobs.

kathleencormier
Download Presentation

ScotGrid Procurement … a future news item

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ScotGrid Procurement… a future news item • 25 June 2006: ScotGrid's 4th birthday • June 25th marks the fourth anniversary of ScotGrid deployment. After four years, the system has provided more than 2 million CPU hours and 200,000 completed jobs. • The system is fully integrated with the LCG Grid, the basic Grid system for the EU Enabling Grids for E-Science in Europe (EGEE) project, and the Grid for UK Particle Physics (GridPP) testbed as part of the National Grid Service. • Locally, the user service supports 12 Groups (ATLAS, BaBar, Bioinformatics, CDF, Device Modelling, Grid Data Management, Information Retrieval, LHCb, Medipix, MICE, UKQCD and ZEUS) with approximately 100 individual users. • Many external Grid Virtual Organisations are also being supported. • The hardware is currently being upgraded and will be available for users in Q3 2006…. ScotGrid Phase 2 Procurement

  2. Grid Overview • Aim: by 2008 (full year’s data taking) • CPU ~100MSi2k (100,000 CPUs) • Storage ~80PB • - Involving >100 institutes worldwide • Build on complex middleware being developed in advanced Grid technology projects, both in Europe (Glite) and in the USA (VDT) • Prototype went live in September 2003 in 12 countries • Extensively tested by the LHC experiments in September 2004 • 197 sites, 13,797 CPUs, 5PB storage in September 2005 ScotGrid Phase 2 Procurement

  3. What is GridPP? • Large UK-wide Project (20 Institutes, £33m over six years [Sep 2001- Aug 07]) • A team that built a working prototype Grid of significant scale UK (worldwide) > 2,000 (10,000) CPUs > 1,000 (5,000) TB of storage > 1,000 (6,000) simultaneous jobs • A complex project where 88% of the milestones were completed in the first phase ScotGrid Phase 2 Procurement

  4. What is ? • Glasgow/Edinburgh/Durham/ (Dundee) Project • Compute-intensive jobs performed at Glasgow and Durham • Data-intensive jobs performed at Edinburgh • First applications using the Grid. Meeting real requirements of Grid applications: currently Particle Physics, Bioinformatics, Computing Science, Electrical Engineering • Glasgow leading R&D in Grid Data Management and Security • Edinburgh leading co-ordination and R&D in Networking and Storage • Management part of a worldwide Grid infrastructure through GridPP and EGEE ScotGrid Phase 2 Procurement

  5. What are the Grid challenges? 2. Software efficiency 1. Software process 3. Deployment planning 4. Link centres 10. Policies 5. Share data Data Management, Security and Sharing 9. Accounting 8. Analyse data 7. Install software 6. Manage data ScotGrid Phase 2 Procurement

  6. Tier Structure CERN computer centre Tier 0 Offline farm RAL,UK USA Germany Italy France Tier 1 National centres Online system Tier 2 Regional groups ScotGrid NorthGrid SouthGrid London Tier 3 Institutes Dundee Glasgow Edinburgh Durham Tier 4 Workstations ScotGrid Phase 2 Procurement

  7. Timescales • Service Challenges – UK deployment plans • End point April ’07 • Context: first real (cosmics) data ’05 ScotGrid Phase 2 Procurement

  8. Middleware www.glite.org • 15 Baseline Services for a functional Grid • Scottish (and National) Grid Service will rely upon gLite components • This middleware builds upon VDT (Globus and Condor) and meets the requirements of all the basic scientific use cases: • Green (amber) areas are (almost) agreed as part of the shared generic middleware stack by each of the application areas • Red are areas where generic middleware competes with application-specific software. ScotGrid Phase 2 Procurement

  9. Middleware ScotGrid Phase 2 Procurement

  10. Middleware Re-engineering www.glite.org • A series of gLite releases have been produced (1.1, 1.2, 1.3, and 1.4) • Driven by application and deployment needs • Focus on defect fixing • gLite deployed on a Pre-Production Service and made available for application use • Independent evaluation by NGS • gLite components also available via VDT (US) • gLite components deployed on the infrastructure • More scheduled by the end of the year • Emphasis is now on release of gLite 1.5 • Will continue… • EGEE phase 2 starts in April 2006 ScotGrid Phase 2 Procurement

  11. Metrics and Quality Assurance ScotGrid Phase 2 Procurement

  12. Wider Application Support • More than 20 applications from 7 domains • High Energy Physics • 4 LHC experiments (ALICE, ATLAS, CMS, LHCb) • BaBar, CDF, DØ, ZEUS • Biomedicine • Bioinformatics (Drug Discovery, GPS@, Xmipp_MLrefine, etc.) • Medical imaging (GATE, CDSS, gPTM3D, SiMRI 3D, etc.) • Earth Sciences • Earth Observation, Solid Earth Physics, Hydrology, Climate • Computational Chemistry • Astronomy • MAGIC • Planck • Geo-Physics • EGEODE • Financial Simulation • E-GRID Another 8 applications from 4 domains are in evaluation stage ScotGrid Phase 2 Procurement

  13. Example: “UK contributes to EGEE's battle with malaria” Number of Biomedical jobs processed by country BioMed Successes/Day 1107 Success % 77% WISDOM (Wide In Silico Docking On Malaria) The first biomedical data challenge for drug discovery, which ran on the EGEE grid production service from 11 July 2005 until 19 August 2005. GridPP resources in the UK contributed ~100,000 kSI2k-hours from 9 sites Normalised CPU hours contributed to the biomedical VO for UK sites, July-August 2005 ScotGrid Phase 2 Procurement

  14. Accounting ScotGrid Phase 2 Procurement

  15. Summary • ScotGrid is part of an evolving National and International Grid • Deployment, middleware and application support status provide a context for Grid procurements here and elsewhere • External developments and timelines place constraints on the hardware being procured for ScotGrid Phase 2 ScotGrid Phase 2 Procurement

More Related