EU-IndiaGrid Interoperability: status and plans

1. International Grid Interoperability and Interoperation Workshop (IGIIW07) Bangalore, 10 December 2007 EU-IndiaGrid Interoperability: status and plans Marco Verlato

2. Outline • EU-IndiaGrid project overview • Objectives • Activities • 1st year achievements • Interoperability between EGEE and GARUDA • Analysis • Strategy • Some scenarios • Conclusions

3. An EGEE related project

4. Indian Grid Projects • India has two main grid infrastructures: • The GARUDA National Grid Initiative • The Department of Atomic Energy (DAE) Grid GARUDA Grid • Private Network • Connecting 45 institutes in 17 cities • 100 and 10 Mbps links 4 Mbps Link 4 Mbps Link CAT: archival storage VECC: real-time Data collection BARC: Computing with shared controls IGCAR: wide-area Data dissemination DAE Grid (gLite based)

5. Slide from Natraj C Addekoppa’s talk at Taipei Workshop GARUDA components • Application (PoC) • Disaster Management • Bioinformatics • Management & Monitoring • Paryaveekshanam • Access Methods • Access Portal • Problem Solving Environments • Data Management • Storage Resource Broker • Resources • Compute, Data, Storage, • Scientific Instruments, • Softwares,.. • Development Environment • DIViA for Grid • Resource Mgmt & Scheduling • Moab from Cluster Resources • Load Leveler, Torque • Globus 2.x • Collaborative Environment • Video Conferencing over IP • Access Grid

6. EU-IndiaGrid goals • To support the interconnection and interoperability between EGEE and GARUDA for the benefit of e-Science applications • To build an e-Science Network Community: • identify and aggregate research, scientific and industrial communities which may benefit from the use of Grid • To promote the use of advanced Grid technologies in scientific communities • Specific pilot applications (HEP, Biology, Material Science, Earth and Atmospheric Sciences) and dissemination activities • Project start: October 2006 • Duration: 24 months

7. PARTICIPANTS EUROPE • INFN (project coordinator) • Metaware SpA • Italian Academic and Research Network (GARR) • Cambridge UniversityINTERNATIONAL • Abdu Salam International Centre for Theoretical PhysicsINDIA • Indian Education and Research Network (ERNET) • University of Pune • SAHA Institute of Nuclear Physics, Kolkata • Centre for Development of Advanced Computing (C-DAC) • Bhabha Atomic Research Centre, Mumbai • TATA Institute for Fundamental Research (Mumbai) National Centre for Biological Sciences (Bangalore) • Not formally, but concretely: VECC, Kolkata and MIT, Chennai

8. Activities

9. Main 1st year achievements • Five Project Workshops + several trainings • Mumbai, Dec 2006; Bangalore, Apr 2007; Kolkata, Jun 2007; Pune, Sep 2007; Taipei, Nov 2007 • EU-IndiaGrid Project Conference here this week • Enabling exploitation of high bandwidth EU-India network connectivity • 45Mbps in October 2006; 1Gbps November 2007 • Supporting the creation of the National Indian CA • Operating the euindia VO and infrastructure with >1200 CPUs , >10 CPU.years consumed by appl.s • many scientific applications ported on both GARUDA and EGEE grids see posters at this conference

10. Interoperability/1 • The 2nd year will be more focused on Interoperability • The 1st year was spent in: • achieving some pre-requisites: • ASGC CA acting as catch-all CA until the Indian National CA is established and approved by APGridPMA • Interconnecting GARUDA’s private network with the intercontinental link • carefully analysing the gLite and GARUDA middlewares • discussing among partners a number of possible interoperability scenarios • defining a stepwise strategy to achieve the goal

11. Interoperability/2 • It was soon recognized the need of: • taking advantage from EUChinaGrid experience about interoperability with CNGrid GOS middleware • identifying solutions being compliant with consolidated/emerging standards (GLUE, JSDL, OGSA-BES, gridFTP, SRM) • Corresponding actions undertaken: • EU-Asia Interoperability sessions/workshops/round tables organised at international grid events • at EGEE’07 of Budapest, October 2007 • at WLCG-Tier2/EU-IndiaGrid Workshop of Taipei, November 2007 • at IGIIW and EU-IndiaGrid Conference of Bangalore, this week • Participation to Open Grid Forum Interoperability Panel planned from OGF22, February 2008

12. Picture taken at Mumbai Workshop, December 2006 ANALYSIS

13. MW components analysis PORTAL GSI+ VOMS UI GSI+ gridmapfile MOAB WMS BDII MDS GLOBUS JC+LM LFC GARUDA-CE (GT2 based) lcg-CE (GT2 based) SRB SRM WN-1 PBS-LikeLRMS WN-2 Linux + AIX WN-n

14. The strategy • To deploy gLite middleware at Indian partners sites • CE and SE deployed at VECC, Kolkata in September 2007 • First full-fledged gLite testbed deployed at MIT, Chennai in October 2007 • CDAC-Bangalore and Pune coming soon • To implement a “basic” job submission interoperation scenario with the present middleware components • To implement a more advanced scenario evaluating/adapting the EUChinaGrid Gateway • To implement Data Management interoperation leveraging SRM-SRB interface developed by ASGC • To design a true interoperability model based on OGF standards, to be implemented in a future I3 project

15. lcg-CE(Torque) lcg-CE(Torque) lcg-CE(Torque) lcg-CE In case of AIX sys.could be evaluatedAIX-ENEA solution Mixed WN:GARUDA + gLite TAR-WN WNs must supportboth environments Basic Job submission interoperation VOMS GARUDA portal gLite (TAR) UI or subset (WMproxy APIs) gLite UI gLite WMS BDII gLite Resourcescloud

16. ENEA-Grid approach to provide access to AIX • Can be applied on other contexts, being based on: • availability of a shared file system on the site WN and on the GRID Proxy WN • use of a remote execution tool for implementing the wrapper it works also with NFS or GPFS it works also with rsh or ssh Invasiveness of the grid middleware and firewall requirements are minimized !

17. Slides from Subrata Chattopadhyay’s talk at EGEE’07 EUChinaGrid Gateway/Adapter Approach

18. SRM SRB Data Management Interoperation • ASGC is developing a SRM interface to SRB • DEMO at SC’07 • Short term plan • Implement interface compatible with SRM version 2.2 • Mid-term plan • Interact and test with other data management systems such as Castor, dCache,…,etc. • Long-term plan • Interoperate with gLite. • Hope glite users who join VO can access files and resources in SRB and vice versa. Thanks to Fu-Ming Tsai

19. Architecture Overview Thanks to Fu-Ming Tsai • The ICTP team developing StoRM • is part of both EU-IndiaGrid and • SRM-WG of OGF • Possible cooperation with ASGC for: • interacting with StoRM • deploying/adapting the SRM-SRB interface in EU-IndiaGrid Users/applications File transfer (gridftp) File transfer (gridftp) SRM API Core Web Service File catalog Data server management Gridftp/management API Gridftp/management API Cache repository Cache server (+gridftp server) SRB+DSI SRB/gridftp

20. Interoperability with OGF standards • OMII-Europe EU project is delivering components to enable interoperability across different middlewares: • gLite, Globus, UNICORE, OMII-UK and CROWN • For gLite-Globus we could use: • CREAM-BES: new gLite CE compliant with BES and JSDL, beta release in December, stable release by April • GT4 OGSA-BES: pre-alpha version GT4 CE • VOMS for the security (compliant with OGF OGSA AuthZ WG ) • GLUE Schema for the Information System • adapting these components to GARUDA and gLite environment requires effort for development  JRAs in I3 EU Projects

21. CREAM-CLI BES-CLI globus BES conn. gLite BES conn. ICE GT4 GARUDA-CE (GT4 based) BES CREAM-CE (WS based) BES Future job submission using JSDL/BES standards?(thanks to Moreno Marzolla / OMII-EUROPE) GARUDA Portal gLite UI GSI + VOMS GARUDA Scheduler / MOAB gLite WMS BDII with GLUE schema GLOBUS JC+ LM GT2 GARUDA-CE (GT2 based) lcg-CE (GT2 based)

22. Conclusions • The main focus of EU-IndiaGrid Project in its 2nd year will be the interoperability between gLite and GARUDA • Several discussions held, several approaches figured out during the 1st year, and a stepwise strategy has been proposed • The Project is actively organizing panel sessions, round tables, discussions about interoperability with other Projects interested in this matter (EGEE’07 in Budapest, WLCG-WS in Taiwan, eScience 2007 in Bangalore) • A contact with OGF was started late September 2007, the participation at Interoperability Panel at upcoming Open Grid Forum events is planned • EU-IndiaGrid is ending in September 2008 • A proposal is ready for EU-IndiaGrid2, describing a more detailed way on standards adoption/collaboration for job and data management interoperability

23. Thank you