1 / 22

Cracow Grid Workshop CGW'05 (Cracow, Poland)

ADAPTING THE DEVELOPMENT MODEL OF THE GRID ANATOMY TO MEET THE NEEDS OF VARIOUS APPLICATION DOMAINS Soha Maad , Brian Coghlan, Gabriel Pierantoni, Eamonn Kenny, John Ryan, Watson Ronan Trinity College Dublin, Dublin, Ireland. Cracow Grid Workshop CGW'05 (Cracow, Poland). Outline.

audra
Download Presentation

Cracow Grid Workshop CGW'05 (Cracow, Poland)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ADAPTING THE DEVELOPMENT MODEL OF THE GRID ANATOMY TO MEET THE NEEDS OF VARIOUS APPLICATION DOMAINSSoha Maad, Brian Coghlan, Gabriel Pierantoni, Eamonn Kenny, John Ryan, Watson RonanTrinity College Dublin, Dublin, Ireland Cracow Grid Workshop CGW'05 (Cracow, Poland)

  2. Outline • The grid in various application domains • Application domain and grid middleware development • Software Engineering perspective on grid middleware development • Software Engineering Practice Proposed • A concrete implementation example Cracow Grid Workshop CGW'05 (Cracow, Poland)

  3. Limitation Grid Solution Challenge Government Chemistry Engineering Environment Finance Astronomy Media Medicine Physics The grid in various application domains Cracow Grid Workshop CGW'05 (Cracow, Poland)

  4. Limitation meeting the deadline of the start date for conducting the physics experiments Grid Solution the EGEE middleware is developped conducting experiments that need to process tera-bytes scale of data (e.g. LHC, ALICE, ATLAS). Challenge Physics The grid in various application domains Government Chemistry Engineering Environment Finance Astronomy Media Medicine Cracow Grid Workshop CGW'05 (Cracow, Poland)

  5. Grids provide computing power but lack capabilities needed for communication and knowledge sharing. Limitation - Special purpose middleware (e.g. innerGrid Nitya developed by Grid Systems, also CrossGrid) - Resource brokers for the discovery of suitable clusters for the execution of parallel image reconstruction algorithms. - Metagrid Engine that provides a superset of functionalities across different Grid Engines with privacy and QoS. Grid Solution Challenge 1) producing interactive medical simulations (e.g. heart simulation). 2) analysing and managing medical images. 3) supporting virtual collaboration in e-hospital. Medicine The grid in various application domains Government Chemistry Engineering Environment Finance Astronomy Media Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  6. No direct connection between the GFARM system and the telescope devices. Limitation GFARM Grid file system offered a special purpose Grid middleware for data intensive computation Grid Solution Analysis of tera-bytes of astronomical image data from telescopes. This necessitates: data intensive computation; scalable file I/O in GB/s; replica management; and parallel/distributed processing of files. Challenge Astronomy The grid in various application domains Government Chemistry Engineering Environment Finance Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  7. Future research work aims at deploying a WSRF compliant middleware. Limitation For large scale air pollution models: National (UK): 7 institutions using GT3 International: 21 institutions using CrossGrid Grid Solution Challenge parallel running of hundreds of programs corresponding to large scale air pollution, nuclear waste storage, pollution and weathering models Environment The grid in various application domains Government Chemistry Engineering Finance Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  8. - the need for the grid to be aware of the business concepts - to make typical server side applications grid-computing compatible, - to allow CAD applications to interface with the grid. Limitation The VO concept should be enhanced to a robust framework with flexibility, adaptability, and security. Proposed generic business-object-aware middleware extensions: 1) grid-enabling existing applications using toolkits; 2) extending the grid architecture with semantics and ontologies. Grid Solution Challenge Virtual collaboration on design, production and maintenance of products that are described in complex structured product model databases. Engineering The grid in various application domains Government Chemistry Environment Finance Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  9. Difficulties: - To split media production pipeline  distribute it to grid resources; - To guarantee reliable and secure interaction with the pipeline. - To provide reliable and secure interactivity with the grid (CrossGrid is only ‘near-interactive) Limitation Grid Solution CrossGrid: - The development of the Grid Visualisation Kernel (GVK) which allows the visualisation pipeline to be ported on grid resources. - The development of G-Vid which is based on GVKfor production of real time interactive video. Challenge The production, broadcasting, delivery and playout, of interactive media content (audio, video, image) in real time. Media The grid in various application domains Government Chemistry Engineering Environment Finance Astronomy Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  10. Need to converge to web service implementation Limitation Implementation of the Open Grid Service Environment (model large scale computational financial problems as abstract workflows). Grid Solution Challenge 1) Solving real world large scale investment problems 2) Realistic financial modelling 3) Regulatory constraints (Basle II) force big finance houses to create their own grid apps. Finance The grid in various application domains Government Chemistry Engineering Environment Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  11. Grid Solution OpenMolGRID system, based on UNICORE grid middleware. Challenge Molecular design and engineering (e.g. QSAR/QSPR methodology involves 3D structure generation, semi-empirical calculations, descriptor calculation, and model building. Chemistry The grid in various application domains Government Engineering Environment Finance Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  12. Government The grid in various application domains Limitation Grid Solution Challenge Chemistry Engineering Environment Finance Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  13. introducing new metagrid engines developing resource brokers Discussion Impact of the Application Domain on Grid Middleware advising semantic-aware solutions developing grid application toolkits adding new middleware services developing new middleware kernels Raising grid awareness of business concepts Developing special purpose grid middleware Developing grid service APIs Government Chemistry Engineering Environment Finance Astronomy Media Medicine Physics Cracow Grid Workshop CGW'05 (Cracow, Poland)

  14. Key Issue Addressed Grid Middleware Software Development Model Bottom-up approach Top-down approach Cracow Grid Workshop CGW'05 (Cracow, Poland)

  15. Bottom-up Approach “Ecosystem” of Grid Components (Globus Alliance) Individual parts of the system are specified in detail and the parts are then composed to form larger components, which are in turn composed until a complete system is formed The exercise of building a Grid system or application is framed as a software integration problem, hopefully, leveraging existing grid components to reduce the development cost . Cracow Grid Workshop CGW'05 (Cracow, Poland)

  16. Top-Down Approach In WebComG, applications are specified as Condensed Graphs in a manner which is independent of the execution architecture, thus separating the application and execution environments. Cracow Grid Workshop CGW'05 (Cracow, Poland)

  17. However ….. However, our survey reveals that the development cost of grid applications using a bottom-up approach is considerable. By adopting a bottom-up approach, most of grid middleware development has evolved in isolation of application domain needs. Cracow Grid Workshop CGW'05 (Cracow, Poland)

  18. However ….. A top-down approach for grid middleware development may lead to narrow solutions and tend to be less generic Cracow Grid Workshop CGW'05 (Cracow, Poland)

  19. Adapting the development model of the grid anatomy We propose marrying a top-down approach with a bottom-up approach for middleware development: From a software engineering perspective, we need bridge infrastructures capable of merging a top down with a bottom-up approach. This relies on: ● A Unified Computational Model capable of expressing the workflow of operations ● Stateful Web Services for the implementation of the Bridge Infrastructures. Cracow Grid Workshop CGW'05 (Cracow, Poland)

  20. A Concrete Example Border services involve : Guardian services: have the duty to check whether all the conditions to cross the border are met Translation services: have the duty to translate information between the different protocols and languages used in WebCom-G and the various Grid Middlewares. Proxy services have the duty to act in one middleware on behalf of a service residing in the other. Cracow Grid Workshop CGW'05 (Cracow, Poland)

  21. A Concrete Example WebCom-G Interoperability with existing Grid Middleware Border Region WebCom Region LCG2 Region GT4 Region At most two technologies overlap Cracow Grid Workshop CGW'05 (Cracow, Poland)

  22. Thanks Questions Cracow Grid Workshop CGW'05 (Cracow, Poland)

More Related