1 / 13

Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories

Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories. Wolfgang Ziegler , Oliver Wäldrich Fraunhofer Institute SCAI Philipp Wieder Research Centre Jülich Workshop on Collaborative Remote Laboratories In conjunction with e-Science 2006

poppy
Download Presentation

Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Advanced Techniques for Scheduling, Reservation, and Access Management forRemote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI Philipp Wieder Research Centre Jülich Workshop on Collaborative Remote Laboratories In conjunction with e-Science 2006 Amsterdam, December 4, 2006

  2. Acknowledgements • Some of the work reported in this presentation is funded by the German Federal Ministry of Education and Research through the VIOLA project under grant #01AK605F. This presentation also includes work carried out jointly within the CoreGRID Network of Excellence funded by the European Commission’s IST programme under grant #004265. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  3. Content • Motivation • Meta-Scheduling in Grids • The VIOLA environment • WS-Agreement • Integrating Remote Laboratories • Perspectives European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  4. Motivation • Obvious commonalities managing Collaborative Remote Laboratories (CRLs) and Grid resources • Advance reservation allows usage at a defined point in time • Negotiation of usage conditions • SLAs as reliable contracts between provider & consumer • Access control based on roles Evaluate potential of integrating CRLs as resourcesinto existing Grid environments European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  5. VIOLA project • German project founded by BMBF • Duration June 2004 – April 2007 • http://www.viola-testbed.de/ • Goals • Test of advanced network equipment & network architectures • Development & test of software tools for the user-driven dynamical provision of bandwidth • Enhancement and test of new advanced applications (e.g. Grid, Virtual Reality) European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  6. The VIOLA MetaScheduling Service Client • Goal: Co-allocation of MPI jobs • Client initiates the reservation (WS-Agreement) and submits the job-data • Negotiation of timeslot with local schedulers • Interface between MetaScheduling Service and local RMS realised through Adapter pattern • Interface MetaScheduling Service / Adapters based on HTTPS/XML (SOAP) Submission of job data WS-Agreement MetaScheduling Service WS-Agreement Site 1 Site n Network Adapter Adapter Adapter HTTPS HTTPS HTTPS Local Scheduler Site 1 Local Scheduler Site n NetworkRMS … Partial job 1 Partial job n Switch/Router European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  7. Negotiation Protocol European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  8. WS-Agreement Structure Agreement Layer Provider • WS-Agreement characteristics • Protocol for dynamic agreement management • Terms can relate to: • functional description • non-functional properties • WS-Agreement is domain-agnostic • Agreement can involve 4 parties: • agreement initiator and provider • service consumer and provider • State can be published and monitored via agreement properties • Can be chained or nested to represent complex relationships Agreement • Context Create / Query/ Terminate Term Compositor Initiator Service Descriptions ServiceReferences Service Properties Guarantees Creation constraint. Service Layer Server Consumer Operations Service European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  9. Virtual Organisation Management • VOs are used for authorisation in Grids • Already in Globus Toolkit & LCG/gLite • UNICORE in transition • VOs allow the definition of roles and role based authorisation for resource access and usage • However, mostly X.509 certificate based (VOMS/VOMRS) • Shibboleth could be an interesting option for CRLs • Interoperability with existing Grid Infrastructures seems to be a major advantage of using VO technology also for CRLs • Would allow seamless integration European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  10. Integrating Remote Laboratories Collaboration Tool Client Submission of job data WS-Agreement MetaScheduling Service WS-Agreement WS-Agreement Laboratory Site 1 Site n Network Adapter Adapter Adapter Adapter HTTPS HTTPS HTTPS HTTPS Local Scheduler Local Scheduler Site 1 Local Scheduler Site n NetworkRMS … Instruments Partial job 1 Partial job n Switch/Router European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  11. The Role of the MetaScheduling Service • Negotiation of not only computers and network, but also instruments and people • Consideration of additional domain-specific SLA terms • Provision of authorisation information for the initial setup of the collaborative environment • Service orchestration: launching and managing of services, tools, and applications European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  12. Domain-specific tasks • Specification of WS-Agreement SLA terms for CRLs • Connection of the Collaboration Tool to the MetaScheduling Service • Realisation of adaptors towards • laboratories or instruments (possibly via Common Instrument Middleware Arch. (CIMA)) • people to negotiate common time-slot for performing the experiment European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

  13. Status Quo Vadis? • Meta-scheduling demonstration • at IST 2006 & CoreGRID Industrial Conf. 2006 • Groundwater pollution simulation (& steering) • Co-scheduling of clusters & network • Ongoing work • From co-allocation to workflow scheduling • Plans for prototype implementation • Integrating an CRL - looking for volunteers ;-) • Evaluation compared to other approaches European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies

More Related