180 likes | 336 Views
Dynasoar Dynamic Deployment of Web Services on a Grid or the Internet or Why it’s good to be Jobless. Paul Watson & Chris Fowler School of Computing Science University of Newcastle.
E N D
DynasoarDynamic Deployment of Web Services on a Grid or the InternetorWhy it’s good to be Jobless Paul Watson & Chris Fowler School of Computing Science University of Newcastle The Dynasoar team: Chris Fowler, Paul Watson, Charles Kubicek, Arijit Mukherjee, John Colquhoun, Savas Parastatidis, Mark Hewitt The GridShed team: Isi Mitrani, Jennie Palmer, Rob Smith, Paul McKee (BT) & Mike Fisher (BT)
Why Jobs & Services? • Grid applications are being built from Web Services • If the computational requirements can’t be met by the service hosting environment then a job must be created • Do we need both jobs and services? • Dynasoar • a service-only approach to building grid applications • an infrastructure for the dynamic deployment of web services
Dynasoar Components • Web Service Provider (WSP) • exposes service endpoints • accepts the incoming SOAP message sent to the endpoint • chooses a Host Provider and passes the message to it • holds a copy of service code • Host Provider (HP) • manages computational resources (e.g. a cluster or a grid) • accepts the message from the WSP • dynamically deploys the service if necessary • processes the message and returns any response Consumer
Routing to an Existing Service Deployment A request for s2 is routed to an existing deployment of the service
Dynamic service deployment A request to s4 cannot be met by an existing deployment of the service R The deployed service remains in place and can be re-used - unlike job scheduling
Dynasoar Advantages • Simplicity: just services • Efficiency: a deployed service can process many messages • important if cost of deployment is high… e.g. VMs • Support a range of new e-science/ e-business models: • defining the interactions between the major components allows them to be distributed in a variety of ways
Dynamic Outsourcing • Biocorp are experts in writing bioinformatics services • They don’t want to manage their own compute resources • Therefore, they use Hosting Inc to process messages sent to their services • In e-science, BioCorp could be a research group writing specialist e-science services, and Hosting Inc the NGS
The National Grid Service as a Host Provider • A researcher writes their own services but does not have sufficient local compute resources • They deploy a local WSP, and configure it so that it sends messages to the National Grid Service • their services are then transparently deployed on the NGS as required
A Marketplace for e-Science Local Campus Grid National Grid Service
Moving Computation to Data • In many e-science applications analysis services operate on data extracted from a data store (e.g. OGSA-DAI, SRB…) • often large amounts of data are transferred • this may severely limit the performance
Moving Computation to Data • The data owner provides compute resources close to a database • Researchers can write services and deploy them on their own WSP • The service is dynamically deployed close to the database when requests are sent to the WSP
Tripartite Security Model The 3 actors can define policies (XACML) that Dynasoar enforces at run-time, e.g…. WSP: only use Host Providers trusted to not re-use the deployed service without payment HP: accept only messages from WSPs trusted to not send malicious code C: only send the message to a HP trusted not to look at the contents
Current Implementation GridShed Cluster Management
New Host Provider Architecture • Layer as high-level infrastructure over lower level grid fabric • Use OMII Job Submission and Monitoring Service to provide stable interface to different underlying fabrics • Newcastle Grid (Condor), National Grid Service, local clusters,….
Current Work • Deploying Services in Virtual Machines • can encapsulate a complex service implementation environment • Use of QoS to enhance decisions on where to deploy a service • Dynamic database deployment • ogsa-dai, ogsa-dqp
Conclusions • Grid applications can be built entirely from services • jobless grid computing • simpler conceptual model • performance improvements due to sharing the cost of service deployment over multiple requests • Dynasoar is built as a high-level infrastructure on top of existing grid fabrics • Separating the Web Service Provider from the Host Provider – with a well-defined interface – opens up a range of e-science/ e-business models • Demo available at the North East Regional e-Science Centre stand