1 / 95

HEPIX Summary CCR workshop LNGS – June 2008

Learn about the benefits of upgrading to Windows Vista Service Pack 1, including improved performance, faster file copying, and enhanced Internet Explorer. Discover the compatibility issues with drivers and necessary prerequisites for a smooth installation.

genep
Download Presentation

HEPIX Summary CCR workshop LNGS – June 2008

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HEPIX SummaryCCR workshopLNGS – June 2008 Michele Michelotto INFN Padova HEPIX Summary for INFN CCR Workshop - 1

  2. Service Pack 1 – Introduction HEPIX Summary for INFN CCR Workshop - 2 • Service Pack 1 has been released on 15th of February 2008 • It is already May and preparations for the upgrade are not finished • Very heavy • Installation might take even 2 hours • 3 reboots are needed • Strong prerequisites • Several other updates needs to be installed first (KB949939, KB937287, KB935509, KB938371 and eventually KB938759) • Several drivers are not compatible with SP1 (KB948343) • Once installed • Performance and reliability are improved • No new feature

  3. Vista SP1 Main Changes HEPIX Summary for INFN CCR Workshop - 3 • Includes 300+ bug fixes! • Windows Explorer performance improvements • Copying files is faster • 25% faster when copying files locally on the same disk on the same machine • 45% faster when copying files from a remote non-Windows Vista system to a SP1 system • 50% faster when copying files from a remote SP1 system to a local SP1 system • uses less bandwidth while browsing network shares • Copy progress estimation when copying files is fast now • Internet Explorer performance improvements • Especially improved for pages with a lot of JavaScript • Group Policy Management Console • Replaced by Remote Server Administration Tools (RSAT) • Reduced Functionality Mode (RFM) removed • Instead system will continuously popup the user to activate once the grace period is passed • It allows us to get rid of complicated activation schema and rely only on the KMS • Drivers architecture • Several drivers which worked with Vista RTM do not work with SP1! Source:http://technet2.microsoft.com/WindowsVista/en/library/005f921e-f706-401e-abb5-eec42ea0a03e1033.mspx

  4. Vista vs. Vista SP1 Source:http://www.extremetech.com/article2/0,1697,2273203,00.aspPCMark Vantage:http://www.futuremark.com/products/pcmarkvantage/testsuites/ HEPIX Summary for INFN CCR Workshop - 4

  5. Vista vs. Vista SP1 (2) Source:http://www.extremetech.com/article2/0,1697,2273203,00.aspPCMark Vantage:http://www.futuremark.com/products/pcmarkvantage/testsuites/ HEPIX Summary for INFN CCR Workshop - 5

  6. Vista vs. XP  HEPIX Summary for INFN CCR Workshop - 6 Report by Principled Technologies: Responsiveness of Windows Vista ™, Windows Vista ™ SP1, and Windows XP ™ on common business taskshttp://principledtechnologies.com/Clients/Reports/Microsoft/VistaSP1XPVistaBusResp0208.pdf

  7. Vista vs. XP  Source:http://exo-blog.blogspot.com/2007/11/update-re-testing-vista-w2gb-ram-office.html HEPIX Summary for INFN CCR Workshop - 7

  8. Email-performance • Several issues have arisen • Many users with large mail folders 100’s of MBytes some even in GB’s • Storage growing 10Gbytes/month • MBX format makes Backups difficult - • High system loads due to file IO to large files • Mailbox format changed from MBX to MIX format • Hybrid mailbox format - cross b/w single file per mailbox folder and single file per message, breaks a file up into 4MB chunks • Significant improvement in access speed and backup times HEPIX Summary for INFN CCR Workshop - 8

  9. Calendaring • Bedework - http://www.bedework.org/bedework/ • Also looked at • Sun Cal server • Zimbra (yahoo) • Apple iCal • Sharepoint • Citadel • Requirements • Shared calendar • Web interface • Thunderbird integration • Caldev Support • Free/Busy Support • Invitation notification HEPIX Summary for INFN CCR Workshop - 9

  10. What is IPv6? • Same, same • Just like IPv4 (which we all use) • “The stuff underneath TCP” • What you get when you do a dns lookup on a hostname HEPIX Summary for INFN CCR Workshop - 10

  11. What is IPv6? • But different.. • 128-bit instead of 32-bit • 2001:6b0:e:2018:21d:e0ff:fe38:c561 vs 130.239.18.137 • Requires different syscalls for low-level (C, etc) programming (getaddrinfo instead of gethostbyname, etc) • Different DNS resource records • A for IPv4AAAA for IPv6 • reverse zones also different HEPIX Summary for INFN CCR Workshop - 11

  12. Why should we care? • Even if most of us have plenty of IPv4 • Prestige, status, technical excellence, fun, etc • User laptop on a conference only getting a IPv6 address (and a broken webproxy or NAT for IPv4 content) • Political/funding reasons (IPv6 might be an important checkbox item) • IPv4 address space might become worth $$$, without IPv6 you can't sell off unused space HEPIX Summary for INFN CCR Workshop - 12

  13. What worked? • OS support • But see “what needed work” for details • Mainstream software • Most “odd” software • Assuming that you run versions that aren't ancient • Our webserver is still on apache 1.3... HEPIX Summary for INFN CCR Workshop - 13

  14. What needed work • DNS • Local zone management software needed to be extended to understand IPv6 for both forward and reverse zones • Tell bind to listen to the appropriate IPv6 interface, by default it seems to just listen on the IPv4 interface • Log parsing scripts • Or anything else that needs to identify an IP address HEPIX Summary for INFN CCR Workshop - 14

  15. What needed work? • Some odd software • In this case not so much, but some software still can't handle a IPv6 address • This probably applies to lots of grid/HEP/HPC software though • Starting early makes it possible to enable it system by system, and not be rushed if some systems can't be dual-stacked quickly HEPIX Summary for INFN CCR Workshop - 15

  16. What needed work? • AIX sometimes forgets its IPv6 interface • Might be a NIC driver bug (non-IBM card) • Linux NFS only speaks IPv4 • Not a problem as long as you dual-stack, it will just use IPv4 instead • Routing problems • Only noticed by a small minority, but really annoying when you want to have production-like availability of your services • Spontaneous loss of default route HEPIX Summary for INFN CCR Workshop - 16

  17. What needed work? • Static IPv6 adressing on Linux • The Linux kernel is very eager to do addrconf • You can turn it off by sysctl • But! • The sysctl is only accessable once the ipv6 module is loaded and the interface is up • And at that point, Linux is doing the addrconf.., HEPIX Summary for INFN CCR Workshop - 17

  18. What needed work? • The solution, hack /etc/network/interfaces: iface eth0 inet6 static pre-up modprobe ipv6 up /sbin/sysctl -q -w net.ipv6.conf.eth0.autoconf=0 address 2001:6b0:e:2018::137 netmask 64 HEPIX Summary for INFN CCR Workshop - 18

  19. LHC Networking T0-T1 Status and Directions David FosterHead, Communications and Networks CERNMay 2008 HEPIX Summary for INFN CCR Workshop - 19

  20. LHCOPN Architecture 2004 Starting Point HEPIX Summary for INFN CCR Workshop - 20 CERN – March 2007

  21. Hybrid Networking Model HEPIX Summary for INFN CCR Workshop - 21 • Infrastructure is provided by a number of initiatives: • GEANT-2 • Commercial Links • Coordinated Infrastructures (USLHCNet, GLIF) • NRENS + Research Networks (ESNet, I2, Canarie etc) • Operated by the community • “Closed Club” of participants • Routers at the end points • Federated operational model • Evolving • Cross Border Fiber links playing an important role in resiliency.

  22. HEPIX Summary for INFN CCR Workshop - 22

  23. CERN IP connectivity 12.5G SWITCH Geant2 20G COLT - ISP Interoute - ISP Globalcrossing - ISP CA-TRIUMF - Tier1 WHO - CIC 6G CERN WAN Network DE-KIT - Tier1 CITIC74 - CIC ES-PIC - Tier1 20G CIXP Equinix -TIX 40G FR-CCIN2P3 - Tier1 TIFR - Tier2 CH-CERN – Tier0 LHCOPN IT-INFN-CNAF - Tier1 UniGeneva - Tier2 NDGF - Tier1 Russian Tier2s RIPN NL-T1 - Tier1 20G USLHCnet Chicago – NYC - Amst 5G TW-ASGC - Tier1 UK-T1-RAL - Tier1 US-FNAL-CMS - Tier1c US-T1-BNL - Tier1c 10Gbps HEPIX Summary for INFN CCR Workshop - 23 1Gbps 100Mbps

  24. HEPIX Summary for INFN CCR Workshop - 24

  25. GÉANT2: Consortium of 34 NRENs 22 PoPs, ~200 Sites38k km Leased Services, 12k km Dark Fiber Supporting Light Paths for LHC, eVLBI, et al. • Dark Fiber Core Among16 Countries: • Austria • Belgium • Bosnia-Herzegovina • Czech Republic • Denmark • France • Germany • Hungary • Ireland • Italy, • Netherland • Slovakia • Slovenia • Spain • Switzerland • United Kingdom HEPIX Summary for INFN CCR Workshop - 25 H. Doebbeling Multi-Wavelength Core (to 40) + 0.6-10G Loops

  26. USLHCNet Planned Configuration for LHC Startup Emerging StandardsVCAT, LCAS Robust fallback at layer 1 + next-generation hybrid optical network: Dynamic circuit-oriented network services with BW guarantees HEPIX Summary for INFN CCR Workshop - 26 26

  27. US LHCNet in 2008: Increased Reliability NYC 111 8th Brookhaven AC-1 NYC-MANLAN Whitesands LON AMS-SARA Bellport AC-2 WEST EAST Bude VSNL Frankfurt VSNL North Highbridge GVA-CERN Wal, NJ NY60 Hudson CHI-Starlight VSNL South Global Crossing Paris Qwest Atlantic Ocean Pottington (UK) Colt London GEANT LCG Availability requirement: 99.95% • New tender process completed in October • We were able to improve on the pricing, path diversity and SLAs • GC NYC-LON circuit will be cross-connected to the GEANT LON-GVA circuit to make a NYC-GVA circuit HEPIX Summary for INFN CCR Workshop - 27 27

  28. GLIF Open Lambda Exchanges (GOLE) • AMPATH - Miami • CERN/Caltech – Geneva+U.S. • CzechLight - Prague • HKOEP - Hong Kong • KRLight - Daejoen • MAN LAN - New York • MoscowLight - Moscow • NetherLight - Amsterdam • NGIX-East – Wash. D.C. • NorthernLight - Stockholm • Pacific Wave (L.A.) • Pacific Wave (Seattle) - Pacific Wave (Sunnyvale) • StarLight - Chicago • T-LEX - Tokyo • UKLight - London HEPIX Summary for INFN CCR Workshop - 28 28

  29. Global Lambda Integrated FacilityWorld Map – May 2008 HEPIX Summary for INFN CCR Workshop - 29

  30. Traffic Statistics HEPIX Summary for INFN CCR Workshop - 30

  31. Current Situation HEPIX Summary for INFN CCR Workshop - 31 • T0-T1 Network is operational and stable. • But, “The first principle is that you must not fool yourself, and you're the easiest person to fool.”  Richard Feynman • Several areas of weakness • Physical Path Routing • IP Backup • Operational Support • Monitoring

  32. Physical Paths HEPIX Summary for INFN CCR Workshop - 32 • Dante analysed the physical path routing for the OPN links. • The network had been built over time, taking in each case the most direct (and cheapest!) wavelength path in the GEANT network. • Analysis showed many common physical paths of fibers and wavelengths. • Re-routing of some wavelengths has been done. • More costly solution (more intervening equipment) • especially the path from Amsterdam -> CERN • 5x10G on this path.

  33. T0-T1 Lambda routing (schematic) Connect. Communicate. Collaborate DK ES IT SURFnet T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 NL UK CERN-TRIUMF CERN-ASGC FR CH T0 NY Copenhagen ASGC Via SMW-3 or 4 (?) TRIUMF NDGF T0-T1s: CERN-RAL ??? BNL CERN-PIC CERN-IN2P3 Hamburg RAL SARA CERN-CNAF CERN-GRIDKA MAN LAN London CERN-NDGF Amsterdam CERN-SARA Frankfurt AC-2/Yellow DE USLHCNET NY (AC-2) VSNL N USLHCNET NY (VSNL N) USLHCNET Chicago (VSNL S) VSNL S Paris GRIDKA Starlight Strasbourg/Kehl Stuttgart Atlantic Ocean FNAL Zurich Basel Lyon Madrid Barcelona Milan GENEVA IN2P3 CNAF PIC HEPIX Summary for INFN CCR Workshop - 33

  34. T1-T1 Lambda routing (schematic) Connect. Communicate. Collaborate DK ES IT SURFnet T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 NL UK FR CH T0 NY Copenhagen ASGC TRIUMF Via SMW-3 or 4 (?) NDGF T1-T1s: ??? BNL GRIDKA-CNAF Hamburg RAL SARA GRIDKA-IN2P3 GRIDKA-SARA MAN LAN London SARA-NDGF Frankfurt AC-2/Yellow DE VSNL N VSNL S Paris GRIDKA Starlight Strasbourg/Kehl Stuttgart Atlantic Ocean FNAL Zurich Basel Lyon Madrid Barcelona Milan GENEVA IN2P3 CNAF PIC HEPIX Summary for INFN CCR Workshop - 34

  35. Some Initial Observations Connect. Communicate. Collaborate DK ES IT KEY GEANT2 SURFnet NREN T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 T1 USLHCNET NL UK Via SURFnet T1-T1 (CBF) FR CH T0 NY Copenhagen ASGC TRIUMF Via SMW-3 or 4 (?) NDGF ??? BNL Hamburg RAL SARA (Between CERN and BASEL) Following lambdas run in same fibre pair: CERN-GRIDKA CERN-NDGF CERN-SARA CERN-SURFnet-TRIUMF/ASGC (x2) USLHCNET NY (AC-2) Following lambdas run in same (sub-)duct/trench: (all above +) CERN-CNAF USLHCNET NY (VSNL N) [supplier is COLT] Following lambda MAY run in same (sub-)duct/trench as all above: USLHCNET Chicago (VSNL S) [awaiting info from Qwest…] MAN LAN London Frankfurt AC-2/Yellow DE (Between BASEL and Zurich) Following lambdas run in same trench: CERN-CNAF GRIDKA-CNAF (T1-T1) Following lambda MAY run in same trench as all above: USLHCNET Chicago (VSNL S) [awaiting info from Qwest…] VSNL N VSNL S Paris GRIDKA Starlight Strasbourg/Kehl Stuttgart Atlantic Ocean FNAL Zurich Basel Lyon Madrid Barcelona Milan GENEVA IN2P3 CNAF PIC HEPIX Summary for INFN CCR Workshop - 35

  36. IP Backup HEPIX Summary for INFN CCR Workshop - 36 • In case of failures, degraded service may be expected. • This is not yet quantified on a “per failure” basis. • The IP configuration needs to be validated • Some failures have indeed produced successful failover. • Tests executed this month (9th April) • Some sites still have no physical backup paths • PIC (difficult) and RAL (some possibilities)7

  37. Structured Backup Tests9th April HEPIX Summary for INFN CCR Workshop - 37 CERN – March 2007

  38. Real Fiber Cut Near Chicago24th April HEPIX Summary for INFN CCR Workshop - 38 CERN – March 2007

  39. Real Fiber Cut (DE-CH) Near Frankfurt25th April HEPIX Summary for INFN CCR Workshop - 39 CERN – March 2007

  40. HEPIX Summary for INFN CCR Workshop - 40

  41. HEPIX Summary for INFN CCR Workshop - 41

  42. HEPIX Summary for INFN CCR Workshop - 42

  43. HEPIX Summary for INFN CCR Workshop - 43

  44. HEPIX Summary for INFN CCR Workshop - 44

  45. Service configuration overview t0input default t0perm CASTORCMS cmscaf cmsprod t1transfer wan HEPIX Summary for INFN CCR Workshop - 45 CluMan - 45 • Requirement: to see a service overview • … for example, as a HeatMap:

  46. HEPIX Summary for INFN CCR Workshop - 46

  47. HEPIX Summary for INFN CCR Workshop - 47

  48. Status of the LHC HEPIX Summary for INFN CCR Workshop - 48 48

  49. LCG Service Hierarchy Tier-0 – the accelerator centre • Data acquisition & initial processing • Long-term data curation • Data Distribution to Tier-1 centres Tier-1 – “online” to data acquisition process  high availability • Managed Mass Storage – grid-enabled data service • All re-processing passes • Data-heavy analysis • National, regional support Canada – Triumf (Vancouver) France – IN2P3 (Lyon) Germany –Karlsruhe Italy – CNAF (Bologna) Netherlands – NIKHEF/SARA (Amsterdam) Nordic countries – distributed Tier-1 Spain – PIC (Barcelona) Taiwan – Academia SInica (Taipei) UK – CLRC (Oxford) US – FermiLab (Illinois) – Brookhaven (NY) Tier-2 – ~100 centres in ~40 countries • Simulation • End-user analysis – batch and interactive • Services, including Data Archive and Delivery, from Tier-1s HEPIX Summary for INFN CCR Workshop - 49

  50. HEPIX Summary for INFN CCR Workshop - 50

More Related