Global Control of Research Networks

1. Global Control of Research Networks Gigi Karmous-Edwards gigi@mcnc.org International task Force panel

2. Outline • GLIF • Global Network Challenges • Control Challenges for GLIF Community • Community of Contributors • Conclusions

3. GLIFwww.glif.is

4. Global Lambda Integrated Facility www.glif.is

5. GLIF Control Plane and Grid Middleware Integration wg Mission: To agree on the interfaces and protocols to automate and use the control of the contributed Lambda resources to help users on a global scale access optical resources on-demand or pre-scheduled.

6. GLIF Control Plane and Grid Middleware Integration wg w/ Tech wg • Work with GLIF Tech group top establish what are GLIF resources (GOLEs) • Defined Network Elements in NDL (network Description Language) • Software that reads NDL description • Need to write to Google MAP APIs to draw resources on a global bases • Provide algorithm to compute path from broker information • Establish WEB services for connection services Thanks to Jereon Van Der Ham

7. GLIF Automation? WEB Services ? Client B Client A Grid middleware Grid middleware Network Management Network Management Network Management NREN Control Plane NREN Control Plane NREN Control Plane

8. Global Network Challenges

9. New Global Demands on Networks Emerging High-End applications • High bandwidth connectivity between supercomputers (teraflops+) and Data stores, and Instruments globally • Applications/end-users/sensors/instruments requesting optical networking resources host-to-host connections across multiple networks (NRENS, Research projects) • Coordination of network with computational and non-computational resources (CPU, databases, sensors, instruments )

10. New Global Demands on Networks Emerging High-End applications (cont’d) • Mechanisms for retrieving near-real-time information about network resources and network states across all global networks • Mechanism for both advance and fast on-the-fly reservation and set-up • Policy and security enforcement in open scientific environments

11. Control Challenges for GLIF Community

12. Control Challenges for GLIF Community • Local control vs. Global control • Centralized vs. Distributed control • Diversity in Grid middleware • Interoperation between Grid Projects • Interdomain across Global Grid networks - network interdomain protocols, policies (management plane and control plane, Grid … WEB services ) • Dynamic and Adaptive on-demand use of end-to-end networking resources (requires near real-time feedback loop)- Identification of functions and interactions between the control plane, management plane, and Grid middleware

13. Control Challenges for GLIF Community (cont’d) • Monitoring information of resources - i) identification of information, ii) abstraction of information, and iii) frequency of updates • Software algorithms to support multiple classes of software including highly-dynamic, workflow engines, data-driven and event-driven applications • Rethinking the Behavioral Control of Networks • Control/management planes interacting with middleware • Centralized vs. distributed functionality

14. Applications Edge Routers Workflow Engines Application Abstraction Layer (API) Translate app request to policy Resource Manager Co-Scheduler Policy Abstraction Feedback Loop Resource Monitoring Resource Allocation • Discovery • Performance • Policy For SLA Monitoring Policy

15. Control Plane (Distributed Control) “Drivers” Management Plane Operations Support System (OSS) ControlPlane Control Plane “Carrier view” “E-science view” Applications/ Grid middleware Management Plane Operations Support System (OSS) ControlPlane Control Plane Networks Data Plane Data Plane Application Network-wide, global, comprehensive, distributed, fully automated software system that enables interoperability, responsiveness, flexibility, enhanced access to network resources, and, speed and efficiency gain

16. Three Control Entities(NM, CP, Grid Middleware) WEB Services ? Client B Client A Grid middleware Grid middleware Network Management Network Management Network Management NREN Control Plane NREN Control Plane NREN Control Plane

17. Management Plane Functions NE NE NE • Usually rely on client/ server model • Hierarchical management applications communicating to each network element in its domain via a management protocol, (i.e., SNMP, Tl1, XML, etc). Network Management (Hierarchical ) Centralized Vertical Model

18. Control Plane Functions NE NE NE Protocols Protocols • Routing - Intra-domain and Inter-domain, automatic topology and resource discovery, path computation • Signaling - protocols for the establishment and maintenance of connections • Neighbor discovery - NE sharing of details of connectivity to all its neighbors • Local Resource Management - accounting of local available resources Distributed Horizontal Model

19. Grid Middleware Functions • Knows the schedules of the network resources • Path Computation/Traffic Engineering • AAA/Policy Enforcement • Reliability and Performance Predictions • Discovery and Resource Registration • Keeps monitoring information about the network

20. Community ofContributors

21. NRENs, Projects and Initiatives from Around the Globe contribute ….. Open to ALL • Please join us and bring your ideas, experience, and issues as we migrate towards linking the world with LIGHT (Kees)! • NRENs • Government Initiatives • Other Standard bodies: OGF, IETF, ITU, etc…. • Individuals and Organizations • Current Research Projects: • Asia - Japan’s G-lambda project, GLORIAD, etc… • North America - Optiputer, Dragon, UCLPv2, Enlightened, NLR, HOPI, etc…. • EU - Phosphorus, Geant2, NeatherLight, StarPlane, etc…. • Others…

22. Rationale behind SC06 BOF (slides from Dimitra Simeonidou) • A strategic alliance between the two international groups: GLIF control plane and OGF ghpn • Focus: • End-to-end on-demand and advanced scheduling of optical network resources for high-end grid applications • Still many outstanding issues: technical, organizational and policy based • Why Now? • A number of funded research projects to contribute experience and effort • Initiatives planning the next generation of research infrastructures • Wide consensus from the community that we need to change the way we design and deploy networks • Standardisation efforts in parallel with OGF

23. Basis for the proposed liaison (slides from Dimitra Simeonidou) • Collect and analyze existing experience on delivering network services across heterogeneous optical domains • Establish strategic relationships with relevant projects and initiatives: • Research projects (i.e. Enlightened-US, PHOSPHORUS-EU, G-Lambda-Jp, Starplane, GEANT2, UCLPV2, Optiputer, Viola,ePhoton/ONE+ WP-JP-G, COST 291, NOBEL2 ) • Initiatives (i.e. EARNEST-EU ) • Critical appraisal of operational and research experience • Technology benchmarking • Deployment roadmaps • Contribute towards the ghpn standardisation effort • Focused documents defining network interfaces among multiple network and Grid layer

24. Conclusions

25. A Book written by the Community Published!

26. Conclusions • Control Plane research is vital to meeting future generation Grid computing - with a strong focus on algorithms to meet the needs of driving applications. • Simplifying Control of Global network resources in coordination with compute relevant resources (clusters, data store, instruments, etc.) is critical to next generation Scientific and Enterprise advancements. • The Research networks ( w/ exception to Japan’s Carriers) are the ones taking bold steps w/ control plane deployments, testbed infrastructures… Continue to foster collaboration and apply lessons learned to production quickly. • International Collaboration is a very Key ingredient for the future of Scientific discovery - The control of Optical network plays the most critical role in achieving this!

27. Thank You! Gigi Karmous-Edwards gigi@mcnc.org