1 / 11

Quattor usage at TCD

Explore the use of Quattor in Ireland's National Grid Initiative, Grid-Ireland, for automated deployment and consistent configuration. Learn about Quattor features, Transactional Deployment, and tools used for monitoring and management.

pgregory
Download Presentation

Quattor usage at TCD

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Quattor usage at TCD Geoff Quigley, Stephen Childs and Brian Coghlan Trinity College Dublin

  2. Overview • Grid-Ireland • Quattor description • Use of Quattor • Transactional deployment • Kickstart • Virtualisation

  3. Ireland’sNational Grid Initiative Grid-Ireland

  4. Quattor • QWG profiles for gLite • Pan language • Compiles to XML profiles • Open-source and extensible • NCM components • Use standard tools • Ant, svn

  5. TransactionalDeployment • Central repository and web-interface • Python and PHP scripting • Deploy process • Check out from SCDB and build with ant • Sync XML profiles and RPMs to each site • Any failure causes profiles to revert • Nodes at each site poll local gridinstall • Advantages • Automation reduces mistakes • Consistent configuration

  6. quattor usage in Grid-Ireland Stephen Childs Department of Computer Science Trinity College Dublin March 2009

  7. Grid-Ireland Quattor Statistics

  8. Developments and issues • Monitoring expanded further • Nagios: adding local probes, writing component for EGEE NCG • LEMON: upgrade to lemon-web on SL5 • MonAMI fed into Ganglia (DPM, Torque) • Tools • checkdeps more or less working with new SL5 server • quatview actively used and extended (in SCDB repo) • panc 8.2.4 now in use: debugging and logging useful • SCDB: merged “hierarchical sites” model, tweaked VOMS roles • ncm-accounts: Fixed bug - massive speedup • Issues and future work • Would still like equivalent to WN speedup integrated in compiler • Get network, filesystems fully under quattor control • Consistent scheme for monitoring in QWG

  9. Gathering stats • Current count of machine profiles: • svn ls –R $GI_REP_URL|sed -n \'/profiles\/.*\.tpl$/p' • Historic number of machine profiles: • svn ls -r {2008-03-17} -R $GI_REP_URL |sed -n \'/profiles\/.*\.tpl$/p‘ • Number of Xen hosts: • find build/xml/ -name '*.xml.dep'|xargs grep -l 'xen/host'|wc –l • Number of Xen guests: • find build/xml/ -name '*.xml.dep'|xargs grep -l 'xen/guest'|wc –l • SVN checkin stats: • http://mpy-svn-stats.berlios.de/

  10. Links • high-level overview of quattor: • http://quattor.org/wiki/Overview • overview of grid-ireland setup: • http://quattor.org/wiki/Grid_Ireland_Details • collection of links for quattor users (including tutorials): • http://quattor.org/wiki/For_Users • pan language manual: • http://sourceforge.net/project/downloading.php?group_id=221766&filename=pan-language-manual-8.2.8.pdf • wiki for the core templates we use: • http://quattor.org/qwg

More Related