NESSI-Grid Strategic Research Agenda

1. NESSI-Grid Strategic Research Agenda Ricardo Jimenez-Peris (SRA Chief-Editor) Universidad Politecnica de Madrid

2. Introduction: Goal & Timeline May 06 Sep06 Oct06 May 07 Oct07June 08…Oct 08 v0.9 v1.0 v1.5 v2.0 v2.5…v3.0 project early internal SOI-WG community publicroadmapstart draft edition draft edition draft edition • Goal: A Vision & SRA for • a grid-like service-oriented infrastructure for business environments and business applications • Context: NESSI • vision of a service-oriented economy • NESSI scenarios & architecture • Timeline

3. Introduction: Contributors • Contributors (so far) • NESSI-Grid consortium: Telefonica, ATOS, BT, IBM, NOKIA-Siemens, Thales, INRIA, Engineering, SAP • Ricardo Jimenez-Peris (UPM): SRA Editor-in-chief • Ignacio Martín Llorente (UCM): Grid Community Liaison Coordinator for SOI-NWG • 17 research projects • ASSESSGRID, A-WARE, BRIDGEEDUTAIN@GRID, G-ECLIPSE, GRID4ALL GRIDCOMP, GRIDTRUST, HPC4U, KWF GRID, ONTOGRID, SIMDAT, SORMA, XTREEMOS, ProGRID, UNIGRIDSBEinGRID • 8 Infrastructures & Middleware solutions • CESGA, EGEE, GRIA, gLite,UNICORE, GRID4ALL, Globus GridWay, KNOWARC • 23 individual experts • Participants from • SOI NWG meetings, NESSI SRA working group

4. SRA aspects & evolution

5. Vision • Driver • Agile businesses drive adaptive IT • Vision • Business Grids - the adaptive service-oriented utility infrastructure for business applications • Applied SOKU paradigm • Service-Oriented • Knowledge-assisted • Utility • Context • Business applications

6. Methodology Driver & Vision Context(Business Applications) Scenarios & Requirements Infrastructures State of the art(Research & Technology) Research Areas Want Have Technology Trends Compare & Contrast Challenges Expertknowledge BusinessIndicators Roadmap

7. Context • Context: Business Applications • Online applications: • Most business applications are online. • Clients of business applications care about the response time they observe. • Industrial benchmarks for online applications set strict statistical distribution thresholds for the provided response times. • Stateful nature: • Business applications are typically stateful: Conversational (sessions) or persistent state. • Persistent state is updateable with typical workloads ranging from 20-50% of updates. • Transactional Semantics: • State belongs to business so it requires consistency guarantees. • In the advent of concurrent accesses to shared state isolation should be provided. • In the advent of failures, all-or-nothing semantics should be guaranteed. • The outcome of successful transactions should be durable despite failures. • Multi-Tier Architectures • Business applications are typically constructed on top of multi-tier architectures. • Their gridification should be transparent.

8. Context • Context: What is Different from Scientific Applications? • Online vs. offline: • Scientific applications are characterized by being batch applications. • The main concern is high utilization of the underlying infrastructure. • No concern about response time of individual requests. • Stateful vs. stateless: • Scientific applications typically stateless. • Persistent state typically read-only, in some cases write-once read-many. • Read-only workloads. • Transactional Semantics: • Scientific applications are not concerned about transactional semantics. • Scientific grids are not aware of transactions. • Multi-Tier Architectures: • Scientific applications are not typically built on top of multi-tier architectures. • Scientific grids are not aware of multiple tiers.

9. Business Scenarios • Business scenarios • Enterprise: core scenario for traditional infrastructures • Hierarchical Enterprise: includes notion of enterprise policy hierarchies • Hosting: special case of enterprise & virtual organisation • Extended enterprise: includes devices beyond the traditional backend (pervasive, sensors, …) • Dynamic Outsourcing: dynamic migration of IT resources between administrative domains • Mergers & acquisitions: merge of previously separated administrative domains • Virtual organizations: multi-party (at least 3) collaboration and resource/service sharing • Business value networks: complex chains including multiple providers/administrative domains • Mega Services: services to millions of customers across the globe

10. State of the Art • Considered under 3 main perspectives: • Infrastructures • Research and Scientific Grids • Enterprise Grids • Virtual-machines based Grids • Mobile Grids • Research fields • Data Grids, Data Replication, Multitier Systems, Application Development, Performance Engineering, Cost & Revenue Management, Autonomic Computing, Virtualisation, Security, Interoperatiblity • New Technology Trends • Storage and Data Management; Processor Technology; Virtualisation; Network Connectivity; Mobile devices; Sustainability

11. Research Challenges • 47 research challenges • Data Management (scalability, low latency geo, autonomy) • Application Development (automatic parallelism, mobility app support, automatic distribution) • Network Connectivity (end2end, heterogeneity, mobility, adaptiveMiddleware) • Accounting and SLAs (transparent, holistic) • Dependability (self healing, cost awareness, mobile) • Security (isolated zones, policies, identity mngmt, reputation&trust) • Performance (predictable virtualisation, integrated scheduling, prediction, resource mng) • Interoperability (standards, composed multi tiers, dynamic, non functional) • Manageability (mng4Business, new devices, virtualisation&deploy, ctrl&monitor, multiple domains, mediation conflict, self management) • Governance (specifications, enforcement, translation) • Flexibility (support changes, autonomy, scalability, dynamic allocation, large scale, dynamic security) • Mastering Complex Systems (holistic modelling, flexible simulation, integrated tooling) • Overarching Challenges (business value, complexity, architecture driven)

12. ResearchChallenges Governance Overarching Management Long term Flexibility Temporal Accomplishment Acc. & SLAs Depend. Data Mng. Medium term Interop. Performance Short term Complex Syst. Security Network Conn. Challenges Dependency Analysis

13. Market & business indicators • Objectives • To define a collection of GRID-related market & business indicators to: • Help defining the SRA challenges and roadmap • Monitor the impact of the SRA implementation • Main areas • Target market and main players: • Identify from where to extract business indicators • Stakeholders that will benefit from a Service-Oriented Infrastructure • Sectors and main players • Identify how SOI-related tech can improve the solution for the main needs • Needs  functional requirements  priorities  SRA roadmap • Indicators • Purpose: • To measure the actual use of SOI-technology at certain moment in time • To show evolution of this usage  Impact measurement • By comparing periodic snapshots of Business Indicator’s value • Definition of a collection of relevant Business Indicators • Emergence of new vendors, new GRID middleware products, new consulting companies, adoption level on companies,….

14. Roadmap Roadmap dimensions organizational complexity technical reach service enabling VirtualOrganization ExtendedEnterprise Merger &Acquisition HierarchicalEnterprise Enterprise Hosting DynamicOutsourcing MegaServices ValueNetworks

15. Roadmap

16. Conclusions: Key Challenges • Summarizing key challenges • New system architectures • harmonize & advance SOA, SOI, multi-tier, federated and Internet scale • support all kinds of business models, applications and emerging HW env. • provide transparent and integrated access for all relevant stakeholders • Advanced system lifecycle approaches • support transparent knowledge tracking, feedback loops, prediction and simulation from engineering to decommissioning • clear separation of concerns between different stakeholders (Biz vs. IT, …) • adhering to overarching sustainability req. for full variety of Biz scenarios • Advanced infrastructure technologies in terms of • hardware (energy efficient, flexible allocation, virtualization …) • middleware (scalability, new multi-tier system design, flexible storage systems, harmonized virtualization on all layers) • related programming models (parallel & distributed programming, multi-core)

17. Thank you • Thank you!

18. Enabling the next wave of services NETWORKED EUROPEAN SOFTWARE & SERVICE INITIATIVE