La partecipazione del Gruppo Informatica di Lecce al Progetto EU-US GRID

1. La partecipazione del Gruppo Informatica di Lecce al Progetto EU-US GRID ASI Earth Observation Systems ESA High Energy Physics

2. High Energy Physics Sezione INFN-Lecce Intervento trasversale

4. CMS ALICE ATLAS VIRGO Cookbook Requirements GRID Middleware development

5. SARA/Digital PugliaA grid enabled remote sensingdigital library Giovanni Aloisio Massimo Cafaro UNIV. OF LECCE-Italy Carl Kesselman ISI/USC Roy Williams CACR/CALTECH

6. Digital Puglia An NPACI International Collaboration Advancing Digital Library Technology ASI ASI NPACI

7. Five Emerging Models of Networked Parallelism From The Grid • Distributed Computing • || synchronous processing • High-Throughput Computing • || asynchronous processing • On-Demand Computing • || dynamic resources • Data-Intensive Computing • || databases • Collaborative Computing • || scientists

8. EU/US Workshop on Large Scientific Databases Annapolis-Maryland 8-11 Sept. 1999 Supported in part by the National Science Foundation (Grant IIS-9910140) and the European Commission (EU Information Society Technology Programme) Organized by CACR-Caltech and CERN Organizing committee US Paul Messina (DOE/CACR-Caltech) Roy Williams Maria Zemankova EU Giovanni Aloisio (Univ. Lecce) John Darlington (IPC-UK) Fabrizio Gagliardi (CERN)

9. GRID ISSUES • Scalability • Information Modeling • Interoperability • Information flow • Preservation of databases • Education and outreach

10. Data Base Scalability Scalability issues must be considered with respect to: • the quantity of bulk data in the database • the geographical separation of the DB components • complexity and heterogeneity of DBs to be federated • size of the user community • the defining limits of applicability of the DB • the duration of the DB project

11. Data Base Size Research on: • Hierarchical storage systems • Distributed storage systems • Parallel data delivery • Interoperability of “big data” systems

12. For data spread around the system, research on: • Clustering • which data objects should be stored “near” similar objects? • Caching • which data objects should be on fast storage? • Redundancy • which datasets should be stored redundantly in different organizational patterns? • Indexing • how efficient ways to search scientific data can be created? • Summarization • when should summary data be computed on-demand, and when pre-computed?

13. Networking • A crucial requirement for effective GRID EU-US collaboration • is trans-Atlantic data communication that provides: • - high bandwidth • - high availability • - low latency The most important metric is throughput • Regional data centers communicate with each other differently fromthe way they communicate with users

14. DataStreaming • Scheduled streaming as a new paradigm for the analysis of large amount of data • Data architectures • oriented to data movement rather than data storage • Shifting from file-oriented to stream-oriented processing • Constructing new kinds of data management components • Alternative structures for data • New roles for metadata

15. Distributed Databases The data movement generated by queries to the globally-distributed database must be optimized • how queries and processing requests can be formulated to • streamline this optimization process? • how such a query can be split in separate, locally-executed queries, • with machine-specific data access? • how the cost, in terms of computation, communication, and time, • can be estimated before and during execution

16. Distributed Databases • Load-balancing • how computational work and data are spread around GRID? • Replication • what should be replicated among the regional centers? • Protocols for - high-speed - parallel I/O • - synchronous and asynchronous delivery • - real-time steering and control of running jobs

17. Information modeling What is the nature of the contents of the database and its catalog? How the DBs interoperability can be achieved? Standardization of scientific data objects

18. Database Interoperability A common infrastructure providing interoperability between European and US scientific databases • common interfaces • common information model • semantic interoperability How can information from multiple collections be fused to extract new knowledge?

19. Database Interoperability • Federation of collections - wrappers provide an interoperability capability - wrappers in front of existing collections that transform the information content into a standard representation - wrappers or servers are installed in front of the storage systems that support access through a common API - wrappers tend to be limited to the manipulation of relatively small data sets Large scale data manipulation requires the tight integration of data and compute resources

20. Security and Authentication • Log-in once to access multiple, heterogeneous services • Clear and unambiguous Access and control policies

21. Information flow • How does information move in a complex system? • How do users discover the database and its capabilities? • How do users initiate and control a complex processing pipeline?

22. Preservation of databases • How to ensure that digital scientific data is still available, • when necessary, many years in the future? • Preservation description information should be associated with • digital objects so that: - the chain of custody and processing history available - quality of the data specified - relationships to other digital objects recognized - digital objects unambiguously identified - information content not altered in an undocumented manner

23. EGrid - The European Grid Forum Redondo Beach- Agosto 1999

24. ...and many more Now, it is time to put things together