1 / 55

E-Research in Germany

E-Research in Germany. Joint Seminar. November 2009 Dr. Reiner Kallenborn Technische Universität München Library. E-Science / E-Research is …. big computational research. team research.

stuart
Download Presentation

E-Research in Germany

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. E-Research in Germany Joint Seminar November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  2. E-Science / E-Research is … big computational research team research … the large scale science that will increasingly be carried out through distributed global collaborations enabled by the Internet UK National e-Science Centre requiring a different set of working tools and methods networked research dynamic interdisciplinary heterogeneous November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  3. … in former times: E-Science / E-Research is … web access to “static” information … now grid-infrastructures offer: direct access to resources themselves, i.e. CPU power Storage Scientific instruments Applications Data Sensors Middleware Services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  4. Grid-Infrastructures have many advantages Better use of resources Practically infinite storage and CPU capacity Flexibility, scalability Automatic adaptation of complex computation processes Dynamic and concerted operation of networked resources Higher quality results through grid supported development User oriented cost reduction November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  5. E-Science / E-Research … … what’s up in Germany? November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  6. E-Science in Germany up to 2004 Solitary activities UNICORE projects (Uniform Interface to Computing Resources;expired) DFN development programme (expired) Sporadic consortia and projects of individual persons or institutes LHC-Grid at Tier1-Centre Karlsruhe November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  7. E-Science in Germany up to 2004 Grid requirements do not stop at national boundaries German scientists are part of international communities German scientists depend on access to international resources(computers, data, experiments) No national initiative comparable to UK, USA, NL No national effort for a grid infrastructure There is no grid without standards There is no use for each scientific community reinventing all grid aspects Germany can’t afford to throw away opportunities offered by grid computing  several workshop initiated by the Research Centre Karlsruhe and the Helmholtz Association of German Research Centresinitiating D-Grid November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  8.  several workshop initiated by the Research Centre Karlsruhe and the Helmholtz Association of German Research Centresinitiating D-Grid E-Science in Germany from 2004 on: D-Grid D-Grid Strategy Paper and Policy Statement • discussing status and consequences of the grid technology on scientific research and recommending a long-term strategic grid research and development initiative • resulting in an announcement of the German e-Science Initiative by the German Ministry for Research and Education (BMBF) in March 2004, together with a call for proposals in the areas of Grid Computing, e-Learning, and Knowledge Management • Demanding (material) committment of scientific communities •  June 15th, 2004: Initiation of a BMBF D-Grid support programme allocating 300 million Euro within 5 years November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  9. D-Grid: Objectives • Net-based coordinated operation and assignment of computer and storage resources • Constitution of a German wide IT infrastructure for complex applications of research and industry • Covering a multitude of applications • Development of community-specific grid services and working methods • Integration of a broad spectrum of resources and IT services • Hardware: computer and storage systems as well as networking facilities • Software: proprietary, freely available or commercial • Data: internal und external databases • Personnel: counselling, training and support

  10. Physics Medicine D-Grid: Layered Framework User Community Finances Operation / Middleware Support, Security … Services / Resources November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  11. D-Grid: Organization November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  12. D-Grid 1 (2005 – 2008) • Homogenization and qualification of the existing Grid-infrastructure by prototypical applications • Generic middleware development (toolkit for e-science) • IT services for scientists, designed and developed by the ‘early adopters’ of the computer science and scientific computing communities • This global services infrastructure is being tested and used by so-called Community Grids in the areas of highenergy physics, astrophysics, alternative energy, medicine and life sciences, earth sciences (e.g. climate), engineering sciences, and scientific libraries • Target groups: Science and scientific computing communities November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  13. D-Grid 2 (2008 – 2010) • stronger focus on grids with industry participation, with more than 40 companies involved • national Grid-Infrastructure on production level • establishing of e-science applications and services in • Construction industry • Finance • Aerospace • Automotive • Enterprise information • Resource planning systems • Geographical data • General IT services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  14. Project Categories in D-Grid Academic Applications Service Projects Commercial Applications Gap Projects Integration Project November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  15. Special Projects New Projects Management of Virtual Organisations Monitoring of Resources and Services Short-lived Certificates Net Attacks Recognition Interoperability of Scheduling Systems November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  16. Service Projects New Projects Management Information Systems Backup und Recovery Sustainability of Grid Infrastructures Support for Service Level Agreements Grid-based Knowledge Structures November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  17. Academic Applications Astronomy Climate Research High Energy Physics Medicine Engineering Humanities November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  18. Commercial Applications Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  19. New Commercial Applications Logistics Analyses and Use of Multimedia Data Molecular Simulation Optimisation via Numerical Simulation Analyses of Medical Signal and Image Data Plasma Technology Support of Dynamic Value Added Networks November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  20. D-Grid History Integration Project Special Projects Service Projects Academic Applications Commercial Applications D-Grid Ltd. 2004 2005 2006 2007 2008 2009 2010 2011 2012 Working Groups Pre-Projects Phase 1 Phase 2 Phase 3 November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  21. Forthcoming Endeavour: Sustainability November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  22. D-Grid 3 (2009 - ): Structural Concepts of the D-Grid Initiative • Integration Project und Gap Projects • Procedures of resource integration • Procedures for generic grid management of resources • Universally valid security models and operational concepts • Business model DGSE (D-Grid Support Establishment) • Service Layer Projects • Offer of community-overlapping services • Compatibility with standards of the German Computer Science Association • Use of proprietary business models • Community Projects • Offers for users within the community • Recipients of DGSE capacities and of service providers November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  23. D-Grid Ltd. (founded 2008) - Coordination, Use of Resources • Direct contracts between user and provider • In case of only few bilateral contacts • Contracts between community and provider • Delegation of trust to the users within a community • Framework agreements between communities and Gauss Alliance • Gauss Alliance = Community of German Computer Centres • Framework agreements between community representatives and providers • Example: Licences for D-Grid • Special regulations for investment and special grants November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  24. Refional group (bwGRiD) Hamburg Bremerhaven Core group Oldenburg User group (C3-Grid) Berlin Berlin Berlin Hannover Further resource provider Paderborn Paderborn Göttingen Göttingen Dortmund Leipzig Leipzig Wuppertal Wuppertal Jülich Kassel Kassel Dresden Köln Siegen Siegen Bonn Bonn Aachen Aachen Marburg Marburg Darmstadt Darmstadt Würzburg Würzburg Offenbach Mannheim Heidelberg Karlsruhe Stuttgart Ulm Tübingen München Freiburg Konstanz D-Grid Resources

  25. Organisational Matters International Cooperation Publicity Matters Legal Matters Development of an Organisational Structure D-Grid Ltd. Vertretung Representatives? Vertretung Gauss Alliance WissGrid Industrial Applications Providers of IT Services and Resources Academic Domains of Application November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  26. 290 Sites 55 Countries 144.000 Cores 25 PetaBytes Disk >17.000 Users >200 VOs >330.000 Jobs/Day Archaeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … 25th NORDUnet Conference, Copenhagen Dieter Kranzlmüller 26 Status July 2009: http://project.eu-egee.org/index.php?id=417

  27. EGI, European Grid Initiative 42 European NGIs + Asia, US, Latin America + OGF-Europe + PRACE + …

  28. … how do libraries fit in? E-Science / E-Research … November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  29. The Evolving World of e-Science: Impact and Implications for Science and Technology Libraries Purdue University (West Lafayette, IN) and Chicago, IL, United StatesJune 20-24, 2010 http://blogs.lib.purdue.edu/iatul2010/ 31st Annual IATUL Conference November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  30. Join IATUL! Thank you! November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  31. References http://www.d-grid.de/ H.-G. Hegering: D-Grid Initiative – Statusbericht http://www.rv-nrw.de/content/koop/workshops/20040601.dgrid/Hegering_DGrid_Statusbericht_ZKI_Mar04.pdf W. Gentzsch: 2007D-Grid and the Integration of New Communities http://www.ogf.org/OGF20/materials/783/OGF20-D-grid.pdf F. Schlie-Roosen et al.: German Steps to e-Science http://www.pd.infn.it/einfrastructures/eirgSlides/German_View_escience.pdf U. Lang: D-Grid – Hype and reality http://www.dini.de/veranstaltungen/jahrestagungen/2009/ H. Neuroth, M. Kerzel, W. Gentzsch http://webdoc.sub.gwdg.de/univerlag/2007/D-Grid_en.pdf U. Schwiegelshohn http://www.d-grid-ggmbh.de/downloads/BroschuereAHM2009.pdf November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  32. Special Projects New Projects IVOM: Integration of Shibboleth into the D-Grid infrastructure and the enhancement of the corresponding VO-Management Management of Virtual Organisations Monitoring of Resources and Services Short-lived Certificates Net Attacks Recognition Interoperability of Scheduling Systems November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  33. Special Projects New Projects Management of Virtual Organisations Monitoring of Resources and Services Short-lived Certificates Net Attacks Recognition Interoperability of Scheduling Systems D-MON: Realization of a Grid wide monitoring architecture across several underlying, heterogeneous systems taking in consideration multiple resource providers and virtual organisations November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  34. Special Projects Management of Virtual Organisations Monitoring of Resources and Services Short-lived Certificates Net Attacks Recognition Interoperability of Scheduling Systems GIDS: Grid Intrusion Detection Systems November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  35. Special Projects Management of Virtual Organisations Monitoring of Resources and Services Short-lived Certificates Net Attacks Recognition Interoperability of Scheduling Systems DGSI: conception and development of an interoperability layer for scheduling in service Grids, allowing the users of a community to distribute the workload among resources within the management domain of another community November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  36. Service Projects New Projects BisGRID: Enabling Grid technologies to be used for the integration of decentralised business information systems. This will be achieved by developing and providing organisational and technical extensions based on the current state of the art in Grid technologies, EAI, and SOA Management Information Systems Backup und Recovery Sustainability of Grid Infrastructures Support for Service Level Agreements Grid-based Knowledge Structures November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  37. Service Projects New Projects Management Information Systems Backup und Recovery Sustainability of Grid Infrastructures Support for Service Level Agreements Grid-based Knowledge Structures F&L Grid: Establishing a generic service-grid for research and education. The pilot sevice-offering will be Backup- and Archive services, later expanded to Information Lifecycle Management November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  38. Service Projects New Projects Management Information Systems Backup und Recovery Sustainability of Grid Infrastructures Support for Service Level Agreements Grid-based Knowledge Structures SuGI: Dissemination of the knowledge of grid technology and enhancement of its use, especially the organization of training courses and the multimedia processing of further D-Grid courses for Web based publishing. November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  39. Academic Applications • AstroGrid-D • Joining together astronomical science institutions into a unified nationwide research infrastructure of collaborative distributed environments using innovative grid technology • Creation of a grid based infrastructure for astronomical and astrophysical research, based on integration of their computational facilities, improving the efficiency and usability of their hardware resources • Integration of distributed astronomical data archives and, in an extended time frame, of instruments and experiments into a common research infrastructure • Support of other research institutes to enable them to share their resources, data and application software within the AstroGrid infrastructure, especially to enable small university workgroups to join the collaboration • Strengthening the ties of the German astronomy community to the huge developments within the international activities of the astronomy community Astronomy Climate Research High Energy Physics Medicine Engineering Humanities November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  40. Academic Applications Astronomy Climate Research High Energy Physics Medicine Engineering Humanities • C3 Grid • Connection of distributed climate data archives • Uniform access and central metadata catalogue • Work packages • User Interface (API/GUI) • Grid - Information Service • Connection of local database-systems / Metadata Backend-Interface • Dataproviding and Preprocessing • Grid-Data Management • Coordidated Grid-Scheduling • Implementation and Integration of the C3-Grid • Sustainable Connection with Earth System Science • Project Management and Co-operation with the Integration Project November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  41. Academic Applications Astronomy Climate Research High Energy Physics Medicine Engineering Humanities • HEP Grid work packages • Scalable storage • Job monitoring • Distributed data analysis and use of grid resources November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  42. Academic Applications MediGRID will demonstrate the feasibility and usefulness of grid services in medicine and life sciences by applying these services in biomedical research with multidimensional data and by correlating genotypic and phenotypic data. At the same time generic recommendations for the technical and logical infrastructure are compiled and submitted to the D-GRiD integration project. The MediGRID project has a modular setup: The four methodological modules (middleware, ontology, resource fusion and eScience) plan to incrementally develop and provide a Grid infrastructure while taking into account the need of the biomedical users. The user communities are represented in three research modules for biomedical informatics, image processing and clinical research. The gained experiences are spread to other communities and flow into the further advancement of the project to create synergies and convergence Astronomy Climate Research High Energy Physics Medicine Engineering Humanities November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  43. Academic Applications • inGRID, Innovative Grid Developments for Engineering Applications • Support of virtual prototyping by means of • internet-based collaborative methods • mapping of engineering workflows on a grid environment • integration of specific technical data sources building of portals for selected engineering scenarios. • Development of a knowledge-based system for the optimization of engineering workflows and support of decision-making processes • Development of co-operation, business, safety and confidence models for scientific engineering applications Astronomy Climate Research High Energy Physics Medicine Engineering Humanities November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  44. Academic Applications Astronomy Climate Research High Energy Physics Medicine Engineering Humanities • Text Grid, a Virtual Research Environment for the Humantities • creating a community grid for the collaborative editing, annotation, analysis, and publication of specialist text resources • establishes a truly interdisciplinary platform and a virtual workbench for research • focussed on (annotated) text as a data type November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  45. Commercial Applications AeroGrid: Creating a permanent and practice-oriented grid infrastructure to facilitate co-operation between large-scale research institutions, industry and university research in the field of aeronautics Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  46. Commercial Applications • FinGrid: design and development of three Grid-based prototypes • Prototype I is a pricing and billing component for Grid-based services – in cooperation with Deutsche Bank and IBM • Prototype II is a Grid-based customer portfolio performance measurement and management tool – in cooperation with DataSynapse and Dresdner Bank • Prototype III is an asset-backed security factory based on Grid architecture – in cooperation with FinanzIT and PA Consulting Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  47. Commercial Applications Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services • Biz2Grid aims at migrating industrial business applications to existing grid-middleware systems by developing a price based scheduler to the D-Grid community: • provide foundations for an effective application of Grid technologies in enterprises • design and implementation of the billing and pricing component • business-models have to be developed that are adequate for an application in the Grid • distribute and parallelize real world applications and • conceptualize and implement economic business models at the same time November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  48. Commercial Applications • BauVoGrid: a Grid-based Platform for the Virtual Organisation in Construction • controlled representation of responsibility / authorisation structures • fast configuration and management of both global VO processes and local company-specific processes in accordance with the set up responsibility VO structure • fast, flexible and secure access to information from different sources (documents, drawings, photographic material etc.) both from headquarters and from the construction site • ad-hoc changes in the process flow, using semi-automatic process simulation • mobile capturing of processes and process/product data on the site, thereby providing a basis for faster and more efficient decision making with participation of all site workers Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  49. Commercial Applications Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services GDI Grid: Efficient mining and processing of spatial data for the simulation of noise dispersion and disaster management November 2009 Dr. Reiner Kallenborn Technische Universität München Library

  50. Commercial Applications Aviation Industry Finances Automobile Industry Building and Construction Industry Geographical Information Systems Generic Engineering Applications Meteorology for Renewable Power Industry Cooperative Product Development Medical Engineering and Services • PartnerGrid develops a collaboration platform for the co-operation of companies on the basis of D-Grid. • Typical scenarios of different branches: • Collaboration of the customer and the foundry by the designing of cast parts • Collaboration in the metal- processing industry at the planning of forming processes November 2009 Dr. Reiner Kallenborn Technische Universität München Library

More Related