200 likes | 581 Views
DWDM-RAM vs Layered Grid Architecture. Layered Grid. Layered DWDM-RAM. Application. Application. “Coordinating multiple resources”: ubiquitous infrastructure services, app-specific distributed services. DTS API. Data Transfer Service. Collective. Application Middleware Layer.
E N D
DWDM-RAM vs Layered Grid Architecture Layered Grid Layered DWDM-RAM Application Application “Coordinating multiple resources”: ubiquitous infrastructure services, app-specific distributed services DTS API Data Transfer Service Collective Application Middleware Layer “Sharing single resources”: negotiating access, controlling use Network Resource Service NRS Grid Service API Resource Resource Middleware Layer “Talking to things”: communication (Internet protocols) & security Data Path Control Service l OGSI-ification API Resource Layer Connectivity Optical Control Plane “Controlling things locally”: Access to, & control of, resources Fabric l’s
High performance computing and Processor memory co-allocation Source: Case De Latt Security and Generic AAA Problem Solving Environment Optical Networking Applications and Supporting Tools Researched in other programlines Application Development Support Imported from the Globus toolkit Collective GridServices Fault Management Co-Scheduling Global Queuing Data Cataloguing Authorization Brokering Auditing Monitoring Common GridServices Grid Information Service UniformResourceAccess Communication Services Data Replication Global EventServices Uniform Data Access Grid Security Infrastructure (authentication, proxy, secure transport) Communication Grid access (proxy authentication, authorization, initiation) Fabric Grid task initiation ResourceManager ResourceManager ResourceManager ResourceManager ResourceManager ResourceManager ResourceManager LocalResources net QoS Highspeed Data Transport CPUs Monitors On-Line Storage Scientific Instruments Tertiary Storage layers of increasing abstraction taxonomy
Data Transfer Service Basic Network Resource Service Network Resource Scheduler l1 ln DWDM-RAM Architecture Data-Intensive Applications DTS API Application Middleware Layer Network Resource Service NRS Grid Service API Resource Middleware Layer Data Receiver Service Information Service l OGSI-ification API Dynamic Lambda Grid service ODIN Resource Layer l1 Data Center Data Center ln Dynamic Optical Network OMNInet
Layered Architecture CONNECTION Application Particle Physics Multidisciplinary Simulation DTS GARA GRAM Collaborative NRS Grid Layered Architecture Grid FTP Resource Lambda Data Grid - Globus Services Storage Service SABUL SOAP GSI UDP TCP/HTTP Connectivity IP ODIN Fabric Storage Bricks OMNInet
Application Application Internet Protocol Architecture DMS NRM – OGSA/OGSI compliant Collective Lambda, Lambda path, storage, and CPU resources Resource OGSI communication Connectivity Transport Internet OmniNet Fabric Link Layered Grid Architecture and Lambda Service DWDM-RAM Application My rough mapping Ian Foster’s Layer Architecture
Applications Data Transfer Service Application Middleware Layer Work Flow Service Replica Service Resource Middleware Layer External Grid Services Network Resource Grid Service Information Service Data Receiver Service Basic Network Resource Service Network Resource Scheduler Resource Layer Dynamic Lambda Grid service Data Center Data storage switch l1 l1 Dynamic Optical Network L3 router Data Center Data Path ln ln Data Transmission Plane DWDM-RAM Generalized Architecture
What is Lambda Data Grid? Grid Computing Applications • A service architecture • comply with OGSA • Lambda as an OGSI service • GRAM extension • add parameter of network resource • net resource co-allocation • on-demand and scheduled Lambda • GT3 implementation • contribute code back to GT3 Grid Middleware Data Grid Service Plane Network Service Plane Centralize Optical Network Control Lambda Service
Grid Service Optical Interconnection Applications HTTP SOAP … TCP UDP … Generalized Label Multiplexing: Lambda, OBS, Fiber Switching,.. Fiber
Lambda Hourglass • Data Intensive (DI) app requirements • HEP • Astrophysics/Astronomy • Bioinformatics • Computational Chemistry • Inexpensive disk • 1TB < $1,000 • DWDM • Abundant optical bandwidth • One fiber strand • 280 λs, OC-192 CERN 1-PB Data-Intensive Applications Lambda Data Grid Abundant Optical Bandwidth 2.8 Tbs on single fiber strand
Lambda Data Grid details OGSI Ext OGSA • A framework providing optical paths for Data-Intensive applications • Service architecture • interacts w/ optical control • dedicated on-demand optical path • not on the public Internet • novel data-networking scheduling scheme Intelligent Midleware services DTS Ext Ext NRS Ext Ext Co-allocation Co-reservation GRAM GARA GT3 Services
Grid Middleware OGSA/OGSI Data Grid Service Network Service Centralize Optical Network Control Service Architecture GRAM Net Ext Co-reservation GARA Net Ext Co-allocation Intelligent Services Generic DI Infrastructure DTS NRS Lambda OGSI-ification