1 / 22

Site Report

Site Report. Roberto Gomezel INFN - Trieste. Outline of Presentation. Introduction Environment today Services Network AFS Condor Tier 1 at CNAF INFN Windows Report (Gian Piero Siroli). Computing Environment and security. 90% of boxes are PCs running Linux or Windows

dylan-gould
Download Presentation

Site Report

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Site Report Roberto Gomezel INFN - Trieste

  2. Outline of Presentation • Introduction • Environment today • Services • Network • AFS • Condor • Tier 1 at CNAF • INFN Windows Report (Gian Piero Siroli)

  3. Computing Environment and security • 90% of boxes are PCs running Linux or Windows • Mac OS boxes keep on living and growing • Commercial unix boxes only used for specific tasks or needs • VPNs not yet available but they are supposed to be configured almost everywhere by the end of this year (Cisco – NetScreen boxes using IPsec) • Network Security • No dedicated Firewall machines • Implemented with access lists on router connected to WAN INFN Site Report – R.Gomezel

  4. Desktop • PCs running Linux and Windows • Automatic installation using Kickstart for Linux and RIS for Windows • Metaframe Citrix or Vmware used to reduce the need to install Windows OS on all PCs for desktop applications • A few sites chose to outsource support for desktop environment due to lack of personnel INFN Site Report – R.Gomezel

  5. Backup • Tape Libraries used: • DLT - widespread • AIT2 – a few sites • Exabyte Mammoth2 – poor used • IBM Magstar – just used at LNF • LTO – many sites are moving from DLT into LTO technology • Backup tools: • IBM Tivoli – quite used • HP Omniback – quite used • Atempo Time Navigator – just a few sites • Domestic tool - widespread INFN Site Report – R.Gomezel

  6. Wireless LAN • Access point running standard 802.11b • All sites are using wireless connection as meeting or conferences are running • Most of them use it to give connection to laptop computers • Security issues: • Permission based on Secure Port filtering (MAC Address) – poor security • No encryption used • Open problem INFN Site Report – R.Gomezel

  7. E-mail • Mail server • Sendmail – widespread and more used • Postfix – a few sites • Mail access protocol • POP3 • IMAP • IMAP over SSL • Secure Webmail INFN Site Report – R.Gomezel

  8. INFN network • LAN backbone network mainly based on Gigabit Ethernet • Layer 2 and 3 switching • No layer 4 switching • The INFN WAN network is completely integrated into the GARR, nation-wide infrastructure, providing a backbone connectivity at 2.5 Gigabit • Since the 6th of May 2003 GEANT, the Pan-European Research Network, and GARR have been interconnecting at 10Gbit/sec. • 3 * 2.5Gbit/sec to North America via GEANT network for research traffic to USA and global internet INFN Site Report – R.Gomezel

  9. How we share data today • INFN sites heavily utilize AFS services to share data and software throughout sites and both AFS and NFS within local site • Local cells have already moved or are moving server functionality to Linux boxes running OpenAFS software • Authentication and file servers of the nation-wide cell INFN.IT are moving from Tru64 boxes to Linux boxes running OpenAFS by the end of summer • Almost everywhere disks are organized in RAID array system (SCSI and EIDE) to provide storage to farm and central computing facility • There is an increasing usage of NAS and SAN architecture in order to rule over the complexity and to improve the reliability of data INFN Site Report – R.Gomezel

  10. INFN Condor Pool by P.Mazzanti – F. Semeria • Condor converts a collection of unrelated workstations into a high-throughput computing facility. Minimize Wait while Idle And: • …increase throughput. • …do housekeeping. • …improve reliability INFN Site Report – R.Gomezel

  11. The ‘Condor on WAN’ INFN Project by P.Mazzanti – F. Semeria • Approved by the Computing Committee on February 1998. • Goal: install Condor on the INFN WAN and evaluate its effectiveness . • Collaboration INFN-CS Madison-Wisconsin • It has been running as a production tool since 1999 INFN Site Report – R.Gomezel

  12. The INFN-WAN Pool by P.Mazzanti – F. Semeria • Used by many INFN researchers. • The first example in Europe of a national distributed computing environment. • More than 200 CPUs in the INFN WAN Condor Pool • Avarage Pool Utilization (last few years) ~ 80 cpu years INFN Site Report – R.Gomezel

  13. INFN Condor Pool on WAN: checkpoint domains April 2003 Europe/US by P.Mazzanti – F. Semeria 155Mbps TRENTO UDINE MI 19 GARR-B Topology 155 Mbps ATM based Network access points (PoP) main transport nodes radio wave bridge 34M user access E1-E3 TO PD 25 LNL Ts 6 32 FERRARA PAVIA PV 11 GENOVA Central Manager A CNAF 87 BO 71 42 PISA FIRENZE S.Piero PERUGIA LNGS 12 ROMA L’AQUILA ROMA2 LNF NA SASSARI 11 BARI LECCE SALERNO T3 CAGLIARI COSENZA CKPT domain # hosts Default ckpt domain in cnaf PALERMO CATANIA LNS US INFN Site Report – R.Gomezel

  14. Condor At Large by P.Mazzanti – F. Semeria • Growing use in commercial world • Oracle: automated software building & testing • Micron: chip design, simulation, defect analysis, testing • Leica Geosystems: image analysis • many others… • Over 400 Condor pools in production worldwide • USA, Italy, Mexico, Brazil, UK, Germany, Spain, France, Poland, Hungary, more… • More than 14,000 CPUs INFN Site Report – R.Gomezel

  15. INFN – TIER1 by L. dell’Agnello – F. Ruggieri • INFN computing facility for HNEP community • Location: INFN-CNAF, Bologna (Italy) • One of the main nodes on GARR network • Ending prototype phase this year • Fully operational next year • Multi-experiment • LHC experiments, Virgo, CDF • BABAR (3rd quarter 2003) • Resources dynamically assigned to experiments according to their needs • Main (~50%) Italian resource for LCG • Coordination with Italian TIER2s, TIER3s • Participation to grid test-beds (EDG,EDT,GLUE) • Participation to CMS, ATLAS, LHCb Data Challenge INFN Site Report – R.Gomezel

  16. GARR LAN CNAF 1 Gbps FarmSW1 (*) SSR2000 LAN TIER1 Catalyst6500 Switch-lanCNAF (*) FarmSW2(*) FarmSW3(*) LHCBSW1 (*) FarmSWG1 (*) NAS3 NAS2 131.154.99.193 131.154.99.192 Fcds2 Fcds3 Fcds1 (*) vlan tagging enabled 2T SCSI 8T F.C. 1 Gbps link by L. dell’Agnello – F. Ruggieri INFN Site Report – R.Gomezel

  17. TIER1 Resources (1) by L. dell’Agnello – F. Ruggieri • Computing servers (CPU farms) • 150 (320 next summer) 1U bi-processors Pentium III/IV 800-2400 MHz • System installation & administration • Linux RedHat (6.2, 7.2, 7.3) • Experiment specific library software • LCFG (WP4 EDG) • Access to on-line data (DAS, NAS, SAN) • 35 TB (> 70 TB next summer) • Study of Large File System solutions • GFS • GPFS • “SAN on WAN” tests (collaboration with CASPUR) • Test of several Hw technologies (EIDE, SCSI, FC) INFN Site Report – R.Gomezel

  18. TIER1 Resources (2) by L. dell’Agnello – F. Ruggieri • Mass storage/tapes • StorageTek library with 9840 and LTO drives: 180 tapes (100 GB each) • New library with 2000-5000 tapes next summer • CASTOR as front-end software for archiving • Direct access for end-users • Oracle as back-end • Helpdesk • Support for our users • Synergy with EDG testbed sitemanagers • GOC (Deployment in progress) • Personnel: ~ 10 FTE’s INFN Site Report – R.Gomezel

  19. INFN Windows Infrastructure • Estimated total number of Windows nodes: ~6-7000 • Overall platform distribution (large variations among different sites) • W2K: 50% • XP: 16% • W/NT: 9% • W9x: 25% INFN Windows Report – G.P.Siroli

  20. INFN Windows Infrastructure • Domains: • About 1/3 of the sites have just standalone systems • The majority of sites have more than one domain (W2K, W/NT, specific services or groups) collecting the majority on nodes; 1 site using SMS • User generally has local Admin privileges • Metaframe to integrate non-Windows world • About 30% of the sites use some (re)installation or cloning tool (ghost, drive image, RIS or home made) INFN Windows Report – G.P.Siroli

  21. INFN Windows Infrastructure • Storage: • About 50% of the sites have a central server with backup (or RAID) • A few sites use SAMBA and AFS • Still many sites have no central storage management INFN Windows Report – G.P.Siroli

  22. INFN Windows Infrastructure • Security and WAN access: • Mostly no WAN access; use of Windows Terminal Server (WTS) and Metaframe; 1 VPN/Windows • LAN access open; a few sites use VNC for remote management • Antivirus s/w almost everywhere (standalone or local server) • Windows Update regularly used by about 30% of the sites (in same cases irregular use or suggested to the user) • Only very few sites don’t enforce some level of security (user self management) INFN Windows Report – G.P.Siroli

More Related