190 likes | 296 Views
Collaborative Campus Grid - Practices and experiences in Leiden University Campus Grid (LUCGrid). Hui Li Feb 4, 2005. Outline. Introduction Why another Grid? How to build a Grid? Lessons, challenges, and opportunities. A Short Intro to Grid. Why LUCGrid?.
E N D
Collaborative Campus Grid- Practices and experiences in Leiden University Campus Grid (LUCGrid) Hui Li Feb 4, 2005
Outline • Introduction • Why another Grid? • How to build a Grid? • Lessons, challenges, and opportunities ASCI GNARP Workshop
A Short Intro to Grid ASCI GNARP Workshop
Why LUCGrid? • Seminar Grid Computing - a collaborative “system” project • Learning Grids via building a Grid • Inter-faculty collaboration • Exploit existing IT infrastructure • A more “dynamic” system for research ASCI GNARP Workshop
LUCGrid - testbed Grid Portal Server Workstations Biopharmacy* DAS2 (user) Workstations LIACS* DAS1 (owner, 20 PI nodes) ASCI GNARP Workshop
LUCGrid - Middleware • Packages • NSF NMI5 (GT3, Condor, MyProxy, NWS, etc) • VDT 1.1.4 (GT2, Condor, VDS, Netlogger, etc) • Tools • OGCE2 Portal • CSF Metascheduler • Ganglia cluster monitoring • Applications • BLUST (biopharmacy) ASCI GNARP Workshop
Resource Management Component (Proj. 4) Information Services Component (Proj. 5) Portal (Proj. 3) Applications Component (Proj. 8) Security and VO Component (Proj. 6) Data Management Component (Proj. 7) Fabric Management Component (Proj. 1) Desktop Computing Component (Proj. 2) LUCGrid - Components ASCI GNARP Workshop
Project 1: Fabric Management - Setting Up the Testbed • Networking (DHCP, NFS, NTP, DNS, etc) • Linux Automatic Installation Infrastructure • Middleware selection, installation and configuration (VDT) • Security Infrastructure (NIKHEF CA) • Testing and verification • User Support: web site, documentation, mailing lists, trouble ticket system (Bugzilla) ASCI GNARP Workshop
Project 2: Stealing the Idle Cycles ASCI GNARP Workshop
Project 3: LUCGrid Portal • A Grid portal is a web server that provides an interface to Grid services, allowing users to submit jobs, transfer files, and query Grid information services from a standard web browser. • Tools to facilitate building portals: • OGCE2 (Open Grid Computing Environment) • Goal: • Setting up a portal server (lucgrid.liacs.nl) • Integrating with other Grid components ASCI GNARP Workshop
Project 4: Resource Management • Deployment • Condor configuration • CSF as metascheduler • Interfaces to Information Services • Development • Scheduling plugins for CSF ASCI GNARP Workshop
Project 5: Information Services and monitoring ASCI GNARP Workshop
Project 6: Security and VO Management • MyProxy - integration with portal • VO (Virtual Organization) Management • Setting up multiple VOs • Authorization and Manage VOs • VOMS software ASCI GNARP Workshop
Demo • Condor Cluster • file:///Users/hli/Desktop/Ganglia-Report.html • Portal Server • file:///Users/hli/Desktop/LUCGrid-Portal-My-Workspace.html • file:///Users/hli/Desktop/P-f0545bae05-1001w.html ASCI GNARP Workshop
Lessons • Organization • Core team (2-4) for deployment • Carefully designed project for development • Policy and Management • System admin support, firewalls • Management support • Dissemination and support • Education, tutorials • Helpdesk, bugzilla • Maintenance and update • Clear goals • Bioinformatics applications ASCI GNARP Workshop
Challenges • Security • Fabric • Resource Management • Information Services • Data Management • Applications • User Portals ASCI GNARP Workshop
Opportunities • Inter-faculty resource-sharing and collaboration • Inter-campus collaboration • Testbed with many “dynamic” resources for research and development ASCI GNARP Workshop
Acknowledgements • All students in seminar Grid Computing 2004/2005 • David Groep, CT NIKHEF • Lex Wolters ASCI GNARP Workshop
Remarks, questions? http://lucgrid.liacs.nl:8080/uPortal http://www.liacs.nl/~hli