“ National Knowledge Network and Grid - A DAE Perspective ” B.S. Jagadeesh

1. “ National Knowledge Network and Grid - A DAE Perspective ” B.S. Jagadeesh Computer Division BARC. India and CERN: Visions for future Collaboration 01/March/2011

2. Our Approach to Grids has been an evolutionary approach • Anupam Supercomputers • To Achieve Supercomputing Speeds • At least 10 times faster than the available sequential machines in BARC • To build a General Purpose Parallel Computer • Catering to wide variety of problems • General Purpose compute nodes and interconnection network • To keep development cycle short • Use readily available, off-the-shelf components

3. ANUPAM Performance over the years

4. ‘ANUPAM-ADHYA’ 47 Tera Flops

5. Complete solution to scientific problems by exploiting parallelism for • Processing ( parallelization of computation) • I/O ( parallel file system) • Visualization (parallelized graphic pipeline/ Tile Display Unit)

6. Snapshots of Tiled Image Viewer

7. We now have , • Large tiled display • Rendering power with distributed rendering • Scalable to many many pixels and polygons • An attractive alternative to high end graphics system • Deep and rich scientific visualization system

8. Post-tsunami: Nagappattinam, India (Lat: 10.7906° N Lon: 79.8428° E) This one-meter resolution image was taken by Space Imaging's IKONOS satellite on Dec. 29, 2004 — just three days after the devastating tsunami hit. 1M IKONOS Image Acquired: 29 December 2004 Credit "Space Imaging"

9. So, We Need Lots Of Resources Like High Performance Computers, Visualization Tools, Data Collection Tools, Sophisticated Laboratory Equipments Etc. “ Science Has Become Mega Science” “Laboratory Has To Be A Collaboratory” Key Concept is “Sharing By Respecting Administrative Policies”

10. Result Resource Broker GRID CONCEPT User Access Point Grid Resources

11. Many jobs per system One job per system Two systems per JOB Many systems per JOB View all of the above as Single unified resource -- Early days of Computation -- Risc / Workstation Era -- Client-Server Model -- Parallel / Distributed Computing -- Grid Computing Grid concept (another perspective)

12. LHC Computing • LHC (Large Hadron Collider) has become operational and is churning out data. • Data rates per experiment of >100 Mbytes/sec. • >1 Pbytes/year of storage for raw data per experiment. • Computationally problem is so large that can not be solved by a single computer centre • World-wide collaborations and analysis. • Desirable to share computing and analysis throughout the world.

13. LEMONarchitecture

14. QUATTOR • Quattor is a tool suite providing automated installation, configuration and management of clusters and farms • Highly suitable to install, configure and manage Grid computing clusters correctly and automatically • At CERN, currently used to auto manage nodes >2000 with heterogeneous hardware and software applications • Centrally configurable & reproducible installations, run time management for functional & security updates to maximize availability

15. Please visit: http://gridview.cern.ch/GRIDVIEW/

16. National Knowledge Network • Nationwide networks like ANUNET, NICNET,SPACENET did exist • Idea is to Synergize, Integrate and leverage to form National Information Highways • Take everyone onboard (5000 institutes of learning) • . Provide quality of service • .Outlay of Rs 100 crores for Proof of Concept • Envisaged applications are: • Countrywide Classrooms, • Telemedicine, E-Governance, • Grid Technology …..

17. NKN TOPOLOGY All pops are covered by atleast Two NLDs

18. NKN Topology EDGE EDGE Distribution EDGE Core EDGE Distribution Distribution EDGE Current status 15 POPS 78 Institutes have been connected Distribution Work in progress for 27 POPS 550+ Institutes EDGE EDGE EDGE

19. Achieve Higher Availability

20. Educational Institutions NTRO Cert-IN Research Labs CSIR/DAE/ISRO/ICAR NKN EDUSAT National Internet Exchange Points (NIXI) MPLS Clouds INTERNET Broad Band Clouds Connections to Global Networks (e.g. GEANT) National / State Data Centers

21. DAE-wide Applications on NKN • DAE-Grid : Grid resources at BARC, IGCAR, RRCAT and VECC • WLCG and GARUDA • Videoconferencing: with NIC, IITs, IISc • Collab-CAD : Collaborative design of sub assembly of the prototype 500 MW Fast Breeder Reactor from NIC, BARC & IGCAR • Remote classrooms : Amongst different Training schools

22. Quarter Transponder 9 MHz CTCRS, BARC DAE, ECIL, Anushaktinagar , Mumbai Hyderabad Mumbai BARC HWB TIFR IRE BRIT CCCM TMC AERB NPCIL NFC VECC, Kolkata CAT, AMD, AMD, SAHA INST. Indore Secund’bad Shillong IMS, Chennai IOP IPR, TMH HRI, BARC, Bhubaneshwar BARC, BARC, BARC, HWB, HWB, UCIL-I UCIL-II BARC, UCIL-III Ahmedabad MRPU Navi Mumbai Allahabad Trombay Mysore Gauribidnur Tarapur Manuguru Kota Jaduguda Jaduguda Mt.Abu Jaduguda INSAT 3C 8 Carriers of 768 Kbps each Hosp. IGCAR, Kalpakkam BARC FACL Notes: Sites shown in yellow oblongare connected over dedicated landlines. ANUNET WIDE AREA NETWORK

23. ANUNET Leased Links Plan for 11th Plan Delhi Shilong Allahabad Mount Abu Kota Jaduguda Indore Gandhinagar Kolkata Tarapur Bhubneshwar Mumbai Hyderabad Vizag Manguru Mysore Gauribidunir Existing Chennai Proposed Kalpakkam Leased Links Plan All over India

24. DAE & NKN BARC CONDUCTED THE FIRST NKN WORKSHOP TO TRAIN NETWORK ADMINISTRATORS IN DEC, 2008 DAE-GRID COUNTRYWIDE CLASSROOMS OF HBNI SHARING OF DATABASES DISASTER RECOVERY SYSTEMS (planned) DAE GETS ACCESS TO RESOURCES IN THE COUNTRY DAE STANDS TO GAIN IN THAT WE GET ACCESS TO RESOURCES ON GEANT(34 EUROPEAN COUNTRIES), GLORIAD ( RUSSIA,CHINA,USA,NETHERLANDS,CANADA ..), TIEN3 (AUSTRALIA,CHINA,JAPAN,SINGAPORE,…..) Applications …

25. WLCG Collaboration NKN-General (National Collaborations) NKN-Internet (Grenoble-France) Logical Communication Domains Through NKN NKN Router 0 Intranet segment of BARC Internet segment of BARC Anunet (DAE units) BARC – IGCAR Common Users Group (CUG) National Grid Computing CDAC, Pune

26. LAYOUT OF VIRTUAL CLASSROOM Projection Screen 55“ LED 55“ LED Elevation Front HD Camera Teacher HD Camera 55“ LED 55“ LED Elevation Back LAYOUT OF VIRTUAL CLASS ROOM

27. An Example of High bandwidth Application

28. A Collaboratory (ESRF, Grenoble) Collaboratory?

29. Depicts a one degree oscillation photograph on crystals of HIV-1 PR M36I mutant recorded by remotely operating the FIP beamline at ESRF, and OMIT density for the mutation residue I. (Credits: Dr. Jean-Luc Ferrer, Dr. Michel Pirochi & Dr. Jacques Joley, IBS/ESRF, France, Dr. M.V. Hosur & Colleagues, Solid State Physics Division & Computer Division, BARC) E-Governance?

31. COLLABORATIVE DESIGN Collaborative design of reactor components Credits : IGCAR, Kalpakkam, NIC-Delhi, Comp Divn, BARC

32. DAEGrid UTKARSH 4 Sites 6 Clusters 800 Cores • Utkarsh – dual processor-quad core 80 node (BARC) • Aksha-itanium – dual processor 10 node (BARC) • Ramanujam – dual core dual processor 14 node (RRCAT) • Daksha – dual processor 8 node (RRCAT) • Igcgrid-xeon – dual processor 8 node (IGCAR) • Igcgrid2-xeon – quad core 16 node (IGCAR) DAEGrid Connectivity is through NKN – 1 Gbps

33. Categories of Grid Applications               

34. Moving Forward …… • “ ‘Fire and Forget’ to ‘Assured quality of service’ ” • Effect of Process Migration in distributed environments • A Novel Distributed Memory file system • Implementation of Network Swap for Performance Enhancement • Redundancy issues to address the failure of resource brokers • Service center concept using Glite Middleware • Development of Meta-brokers to direct jobs amongst middlewares • All of the above lead towards ensuring Better quality of service and imparting simplicity in Grid usage… clouds?

35. Acknowledgements All colleagues from Computer Division, BARC for help in preparing the presentation material are gratefully acknowledged. We also Acknowledge NIC-Delhi, IGCAR-Kalpakkam and IT-Division, CERN, Geneva. THANK YOU