1 / 28

GARUDA - The National Grid Computing Initiative of India

GARUDA - The National Grid Computing Initiative of India. Subrata Chattopadhyay C-DAC, Bangalore, India subratac@cdac.in. Outline. GARUDA Overview Architecture & Network Resources Partners Applications for PoC Interoperability. Motivation for GARUDA.

hammer
Download Presentation

GARUDA - The National Grid Computing Initiative of India

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GARUDA - The National Grid Computing Initiative of India Subrata Chattopadhyay C-DAC, Bangalore, India subratac@cdac.in

  2. Outline • GARUDA Overview • Architecture & Network • Resources • Partners • Applications for PoC • Interoperability

  3. Motivation for GARUDA • Sharing of high-end computational resources with the larger scientific and engineering community across the country • Emerging High Performance Computing (HPC) applications require integration of geographically distributed resources • Collaborative Framework for solving applications which are interdisciplinary requiring experts from multiple domains and distributed locations • Universal (location-independence, ubiquitous) access to resources Computational Grids effectively address the above application requirements

  4. Project Overview • Precursor to the National Grid Computing Initiative • Test Bed for grid technology/concepts and applications leading to the plan for the main grid initiative • Project initiated by the Dept. of IT in November 2004 • Major Deliverables • Technologies, Architectures, Standards & Research Initiatives • Nation-wide high-speed communication fabric • Aggregation of Grid Resources • Deployment of Select applications of National Importance • Grid Strategic User Group • High-speed Networking Component in collaboration with ERNET

  5. Garuda Component Architecture • Application (PoC) • Disaster Management • Bioinformatics • Management & Monitoring • Paryaveekshanam • Access Methods • Access Portal • Problem Solving Environments • Data Management • Storage Resource Broker • Resources • Compute, Data, Storage, • Scientific Instruments, • Softwares,.. • Development Environment • DIViA for Grid • Resource Mgmt & Scheduling • Moab from Cluster Resources • Load Leveler, Torque • Globus 2.x • Collaborative Environment • Video Conferencing over IP • Access Grid

  6. GARUDA Component Deployment Scenario`

  7. Cyber Infrastructure – Network Fabric • The Proof of Concept network has been established incollaborationwith ERNET • The MPLS Virtual Private Network (VPN) connects 22 institutions at 100 Mbps and 23 institutions at 10 Mbps across 17 Indian cities with SLA agreements • Collaborative environment enabled through Video Conferencing over IP at the following centres of C-DAC : Bangalore, Pune, Chennai, Hyderabad, Mumbai and Trivandrum

  8. Cyber Infrastructure – Resources • In addition to PARAM Padma, Linux Clusters have been setup at Pune, Hyderabad & Chennai • Grid Labs have been setup at Bangalore, Pune & Hyderabad • Fourteen of the partner institutions are contributing resources including satellite terminals (compute aggregating to more than 300 CPUs)

  9. Resource Details • HPC Clusters from C-DAC Bangalore : AIX Cluster Pune, Chennai, Hyderabad : Linux Clusters • Linux Clusters from • IISc & RRI, Bangalore • IMSc & MIT, Chennai • IIT, Guwahati • IIT, Kharagpur • AIX SMP from University of Hyderabad • SAC, Ahmedabad is contributing GSAT3 terminals (GSAT4 when launched) and Satellite bandwidth

  10. Resource Manager for Grids Resource Manager for Grids High Availability High Availability High Availability High Availability Job submission flow Other Users Bangalore Users Pune Users End Users access the grid through the Garuda Access Portal Garuda Access Portal Bangalore Pune Hyderabad Shared User Space Shared User Space Chennai Shared Data Space Shared Data Space Resource Manager for Grids Resource Manager for Grids Solaris Cluster Linux Cluster AIX Cluster Linux Cluster Linux Cluster

  11. Grid Management & Monitoring Centre • An integrated Resource Management & Monitoring Framework • Network Traffic Analysis and Congestion Management • Help desk for Grid Users

  12. GARUDA Partners • Motivation • To Collaborate on Research and Engineering of Technologies, Architectures, Standards and Applications in Grid Computing • To Contribute to the aggregation of resources in the Grid • Current Participation • 36 research & academic institutions in the 17 cities • ERNET-HQ in Delhi • 8 centres of C-DAC • Total of 45 institutions

  13. GARUDA Partners (contd..) • C-DAC Centres (8): • Pune (2) • Bangalore(2) • Hyderabad • Mumbai • Chennai • Thiruvananthapuram • Academia • Motilal Nehru National Institute of Technology, Allahabad • Indian Institute of Science, Bangalore • Punjab Engineering College, Chandigarh • Madras Institute of Technology, Chennai • Jawaharlal Nehru University, Delhi • Guwahati University, Guwahati • University of Hyderabad, Hyderabad • Indian Institute of Technology at : • Chennai • Delhi • Guwahati • Kanpur • Kharagpur • Mumbai • Roorkee • University of Pune, Pune • Institute of Technology, Banaras Hindu University, Varanasi • Government Collaborators • ERNET India

  14. GARUDA Partners (contd..) • Research Labs & Institutions • Institute for Plasma Research, Ahmedabad • Physical Research Laboratory, Ahmedabad • Space Application Centre, Ahmedabad • Harish Chandra Research Institute, Allahabad • Indian Institute of Astrophysics, Bangalore • National Centre for Biological Sciences, Bangalore • Raman Research Institute, Bangalore • Institute of Mathematical Sciences, Chennai • Institute of Microbial Technology, Chandigarh • Institute of Genomics and Integrative Biology, Delhi • Centre for DNA fingerprinting and Diagnostics, Hyderabad • Saha Institute of Nuclear Physics, Kolkatta • Sanjay Gandhi Post Graduate Institute of Medical Sciences, Lucknow • Bhabha Atomic Research Centre, Mumbai • Tata Institute of Fundamental Research, Mumbai • Inter-University Centre for Astronomy and Astrophysics, Pune • National Chemical Laboratory, Pune • National Centre for Radio Astrophysics, Pune • Regional Cancer Centre, Thiruvananthapuram • Vikram Sarabhai Space Centre, Thiruvananthapuram

  15. Illustrative Applications

  16. Objectives and Deliverables • Objectives • Enable applications of national importance requiring aggregation of geographically distributed resources • Deliverables • Grid enablement of illustrative applications and some demonstrations such as • Bioinformatics • Disaster Management

  17. Bioinformatics • Bioinformatics Resources & Applications Facility (BRAF) on PARAM Padma • Supports highly optimized Bioinformatics codes on the PARAM Padma • Web computing portal providing all computational facility to solve related problems

  18. GRID Communication Fabric User Agencies User Agencies Disaster Management Grid Partner Resource Flight data transmission from nearby Airport High Speed Communication PARAM Padmaat Bangalore at Pune

  19. Virtual User Community • Astrophysics • High Energy Physics & Astronomy • Grid Technology • Disaster Management • Earth Science • Bioinformatics (Genome) • Network Technology

  20. Garuda – EGEE Interoperability • Garuda components • EGEE components • Options for interoperability • Discussion

  21. The files get transferred to the execution machine(s) The job executes The job completes execution The files get transferred to the Grid Head Node Job Submission Flow Through Grid Portal Login to Portal Develop Application Use resource browser and identify the platform PSE Upload Input datasets Write Application Submit Job with its requirements Get & Match Requirement and identify resources Get & Match Requirement and identify resources Compile The files get transferred to the Grid Head Node If Error Yes Use Debugger View O/P files No

  22. User User Genome Grid Garuda Portal Dynamic Resource Scheduling Client GARUDA Globus middleware PUNE Bangalore 100 Mbps Chennai 10 Mbps 10 Mbps 100 Mbps Hyderabad 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster 8 Node Dual CPU Xeon Cluster

  23. EGEE Services Access CLI API Information & Monitoring Services Security Services Authorization Information &Monitoring Service Discovering Auditing Authentication Network Monitoring Data Management Job Mgmt. Services JobProvenance PackageManager MetadataCatalog File & ReplicaCatalog Accounting StorageElement DataMovement WorkloadManagement ComputingElement

  24. Basic Interop. Job submission gLite (TAR)UI or subset(WMProxy APIs) gLite WN & UI TARavailable on SLC3/4 GARUDA Submission (Portal) GARUDA Portal Submission GARUDA LinuxResources PBS-LikeMaster Node gLite Submission (WMS) JDL creation & Job submission gLite WMS WN-1 lcg-CE(PBS submission) WN-2 glIteResourcescloud WN-n In case of AIX sys.could be evaluatedAIX-ENEA solution Mixed WN:GARUDA + gLite TAR-WN WNs must supportGARUDA ENV.

  25. Job Submission Flow for EGEE Grid User

  26. Job Submission Flow for GARUDA Grid User

  27. Challenges ! • Multiple components – evolving • User authentication mechanisms • Complexity and stability • Open source and commercial license • Accounting

  28. Thank you! www.garudaindia.in

More Related