eInfrastructures in Italy (and their EU and International integration) Roma – 9 December 2003

1. eInfrastructures in Italy (and their EU and International integration) Roma – 9 December 2003 Mirco Mazzucato INFN-Padova mirco.mazzucato@pd.infn.it

2. Grids: origin and foundation • Italy started to develop the Grid technology and related eInfrastructures at the end of ’90s (INFN Condor, Grid project, ISUFI Lecce). Main motivations: • Modern fundamental Science, HEP in particular, but also Life sciences, Earth Observation, Economics, … have been evolving fast during the ’90s from local well consolidated laboratory practices towards: • global collaboration (eScience), involving real time working relations between distributed teams with top level expertise • Intensive usage, in the daily work, of IT resources including access and sharing of distributed data • Effective use of modelling practices for the steering of the research and innovation processes • ,,,boosted by the decreasing costs of commodity IT resources: desktop, disks, networks.. and Open Source

3. The “Data” Issue • The modern scientific world and society are characterized by the large development of digital instruments which produces a large amount of distributed raw data • High Energy Physics detectors (LHC): 10 PByte/year in 2007 • Earth Observation satellites: Envisat 500 TByte/year now • Mammography screening of the population in Italy: 200TB/year • Genomic and proteinomic databases quickly growing to PByte • WEB, Digital Libraries,Virtual Reality, CADS: now at TB • Distributed sensors……..: Millions, quickly growing • The economical and social progress of modern digital societies depend strongly on their capacity and efficiency in transforming these Raw Data into precious piece of knowledge: • Laws of nature, new drug discoveries, innovative technologies, early cancer diagnosis, early alarm for a new catastrophic event ….

4. The “modelling” issue • Progress in modern Sciences but also the Innovation processes in modern Industries, Business and Governments relies on the cycle: • Theoretical modelling of the problem • Simulation/Calculations of different options and input parameters • Selection of best solution • Virtual and practical realization of prototypes • Comparison, iteration or mass production • In all domains the extensive professional exploitation of the past accumulated knowledge through the systematic usage of modelling practices should steer the innovation process • To be confronted with current practices of systematic laboratory tests of all different hypothesis and parameters • This points towards the pervasive introduction and systematic usage of IT resources (CPU, Archives, networks..) in the daily work of all people involved in the production of new knowledge and beyond in all society

5. eInfrastructures:the new general enabling factor • The conbination of Internet with the new WEB and Grid Services on top of the modern fastly developing physical layer of networks, CPU farms, storage space.., can provide the general infrastructure (eInfrastructure) which enable all the above tasks: • Collaborative work in distributed VO • large volume data sharing • intensive usage of distributed CPU and Storage resources • General access to knowledge in the society • The Grid middleware can provide those additional common services that applications in all domains from Science to Industry and Business can use to access exactly those ITresource that they need at the most effective cost • As the TCP/IP protocol and the WEB daemons have provided in the past uniforn access to information to Science, Industry and all other domains • eInfrastructures becomes in this way one of the key enabling factors for the social and economical progress of modern knowledge based society

6. The INFN Grid project and the national eInfrastructure • Condor on WAN (started 1996, operational in 1998) • Integrate ~ 20 sites CPU resources into a national pool • National testbed to evaluate Globus services in 1999 • INFN-GRID, INFN special project, (February 2000-…) • National Grid infrastructure driven by INFN experiments • DATAGRID , EU Project, 3 years duration (2001-2003) • European integration and new M/W services for HEP, Biology, EO • DataTAG, EU project, 2 years duration (2002-2003) • Optical networking and Interoperability with US Grid, GLUE, HICB, JTB.. • Grid.IT, National project 3 years (2003-2005) MIUR special funds • Towards a national production eInfrastructure • eBusiness, eIndustry, eGovernment, EScience and, Technology --> (BIGEST) Italian Grid Initiative • Coordination of all national eInfrastructure activities • FP6: Italian grid infrastructure in EGEE..... • The new production EU eInfrastructure for all Sciences and beyond

7. SPACI The SPACI Consortium:a flexible, robust, secure and scalable IT infrastructureSouthernPartnershipforAdvancedComputationalInfrastructure 1.4 Tflops ISUFI/CACT Center for Advanced Computing Technologies University of Lecce Director: Prof. Giovanni Aloisio SPACI infrastructure part of the EGEE production Grid DMA/ICAR Dept. of Mathematics and Applications University of Naples “Federico II” & ICAR (Section of Naples) Director: Prof. Almerico Murli MIUR/HPCC Center of Excellence for High Perfomance Computing University of Calabria Director: Prof. Lucio Grandinetti

8. SPACI SPACI – The Mission • To put the computing resources of the partecipating institutions into a grid • To integrate the research activity of the three main sites and to estabilish a real collaboration in Italy between the Italian Public and Industrial Research • To exchange experiences both in High Technology and Scientific Research among the researchers & students of the three main sites and other Universities & Research Centers in Europe and the USA

9. GEANT boquad.frascati.enea.it ENEA infrastructure will be part of EGEE dafne.casaccia.enea.it power3.frascati.enea.it ENEA GRID GigaBit-Link grid0007 infocal.trisia.enea.it CNR Tor Vergata DataGrid at ESA\ESRIN Citrix Nfuse Citrix Metaframe WEB(ICA) ICA

10. The Grid.it National Project CNR & University HPC, Parallel Programming, Grid computing, Scientific libraries, Data base and knowledge discovery, Earth Observation, Computational chemistry, Image processing, … R&D on next generation tools INFN & University Grid infratsructure(INFN-Grid, DataGrid, DataTag) , e-science applications: Astrophysics, Bioinformatics, Geophysics, … National eInfrastructure ASI Applications of Earth Observation MILANO TORINO PADOVA PAVIA BOLOGNA GENOVA PISA PERUGIA Funding: €8.1 M 3-Year Project Start-up: November 2002 UR INFN : €1.58M ROMA BARI NAPOLI MATERA LECCE CAGLIARI COSENZA CNIT PALERMO R&D on optical networking

11. The national Grid.it eInfrastructure • In Grid.it INFN is responsible for the R&D and creation of a national Grid Infrastructure and for studying and prototyping a national Grid Operation Service (GOS) • The generalization of the infrastructure support to other Sciences from INFN is a model successfully established in the past with the research network (INFNET -> GARR) • The GOS support several Italian Sciences applications and the operation of the Italian infrastructure also in the context of the new European Infrastructure project EGEE • The Italian eScience Grid.it infrastructure currently support: • Astrophysics • Biology • Computational Chemistry • Geophysics • Earth Observation • but other sciences are joining thanks to new MIUR funds (e.g. new S-PACI and other PON projects)

12. Web site: http://grid-it.cnaf.infn.it The Grid.it support site

13. The Italian Grid for Business, Industry, Government, EScience&Technology (IG-BIGEST) • It is a national initiative aiming at coordinating all Italian efforts in Grids development or exploitation and at promoting the participation to EU FP6 and international grid projects • IG-BIGEST main objectives are • To support the creation of a general Italian and EU grid infrastructure for eScience integrating available EU national infrastructures and open to industry early test • -> EGEE project • To promote R&D on open Grid issues • ->New FP6 proposals • To support the development of specific grid environments on top of basic services enabling usage of Grid by major applications in e-Science, eIndustry and eGovernment • ->New FP6 and national application projects

14. Current achievements for the Italian and EU eInfrastructure • The national Grid infrastructure is now a reality costantly developed by a series of coordinated national projects • Garr (NREN) for the underline broadband Research Networking • INFN Grid, S-PACI, ENEA-Grid FIRB Grid.it for Grids and eInfrastructure • Integration at EU and international level is efficiently carried through a series of EU projects DataGrid, DataTAG, EGEE , international HEP LCG... • Grid infrastructures are now seen by many governments as a Science and society development enabling factor and large funds are made available in Europe, US (Cyber-infrastructure), Japan and other countries so technological development will continue fast • EGEE will make the Grid M/W adhering to standard spec. (OGSI-OGSA) robust and reliable and will provide a production eInfrastructure in Europe on top of the Geant nework • EGEE will provide also: • Support to the development of some research eInfrastrcture user communities • Coordination of national and regional technical operational structures

15. eInfrastuctures: the challenges • The general European structure at managerial and policy - administrative level to support the eInfrastructure developments in Europe is still very weak • Projects like EGEE have definite technical goals, are focused and ends • Cannot provide effective long term foundation for an EU eInfrastructure • Cannot provide longterm EU wide roadmaps integrated with national programs • Cannot guarantee long term support of M/W • This is even more true at international level • GGF can provide long term international standards but is not following the urgent policy agreements needed to integrate EU eInfrastructures, with US Cyber-Infratruscture, Japan and world wide Grids • Policies for resource sharing within comunities having common objectives (VO), security issues, accounting, business and cost models etc need now to be actively generally addressed in Europe and internationally

16. The new event “eInfrastructures (Internet and Grids) – The new foundation for knowledge-based Societies” • It offers an opportunity to start to discuss a framework of administrative- and policy-level mechanisms and rules to break down barriers related to deployment and use of eInfrastructures in Europe and world-wide • Some of the issues that need to be addressed include: • The harmonization of national, EU and International eInfrastructures dvelopment programs • The general long term support and coordinated world-wide evolution of the basic eInfrastructure services in order to guarantee continuous world-wide interoperability and usage • Existing GLUE schema, Intergrid Coordination Board, JointTechnical Board, are International Bodies which may provide input and feedback to eIRG • Security EU structures and shared EU and International sec. policies • Authorization, Accounting, Cost sharing and Business models for EU wide and international resource access and sharing • Bringing in all Research user communities • Bringing in general Industry, Business and Society applications

17. Conclusions • EU eInfrastructures are a key element for the establishment of the European Research Area and for boosting in Europe the Scientific Research and Industrial/Commercial outreach, allowing the building up of critical mass in all domains • With the constitution of eIRG Europe can address the issue of putting in place a solid structural foundation at adminstrative and policy level for the eInfrastructure development and involve all Research comunities, Industries and the Society • eInfrastructures can enalarge access to knowledge creating a new market of IT resources and applications as the WEB did in the past • The EU eInfrastructure Reflection Group has been formed with delegates of Ministries of all EU countries following the recommendations of the previous workshop organized by the Greek Presidency. • It can provide harmonization of the adopted policies and input to the EU governments and EU commission for the development of the EU eInfrastructure together with international coordination • The White Paper that has been circulated as a first draft to stimulate discussions is now in the hands of this group • It will evolve according to the input and suggestions provided during the today workshop. • The eIRG will meet tomorrow to plan the next steps