90 likes | 191 Views
Internet End-to-end Monitoring Project at SLAC . Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers Thomas Ndousse & Mary Anne Scott April 27, 2005 www.slac.stanford.edu/grp/scs/net/talk05/site_visit_apr05.ppt.
E N D
Internet End-to-end Monitoring Project at SLAC Les Cottrell, Connie Logg, Jerrod Williams, Gary Buhrmaster Site visit to SLAC by DoE program managers Thomas Ndousse & Mary Anne Scott April 27, 2005 www.slac.stanford.edu/grp/scs/net/talk05/site_visit_apr05.ppt Partially funded by DOE/MICS Field Work Proposal on Internet End-to-end Performance Monitoring (IEPM)
Overview • Personnel/introductions – All,15 minutes • Agenda bash • Datagrid Wide area network Monitoring Infrastructure (DWMI) – Connie, 30 mins • Forecasting/event detection – Les/Fawad, 15 mins • High speed transport evaluation – Les/Parakram 20 mins • 10Gbits/s Testbeds – Les/Gary, 30 mins • SNV/SLAC, UltraLight, USN • SC200x/iGrid • PingER and the Digital Divide – Les 15 mins • Summary/Close out
Personnel • Les Cottrell (PI), Connie Logg, Jerrod Williams (mostly funded by SLAC from overhead) • Draw heavily on systems, network, security (SLAC overhead) • Hiring a Post doc for two year post (mostly MICS funding, DWMI) • High speed measurement tools, web services, proposal writing, understand how to monitor circuit based (USN) infrastructures, QoS/MPLS impacts • Also students: • Stanford RAs (two) • One working on event detection/forecasting • One working on 10GE, high-performance throughput, TCP/UDT evaluations • NIIT students (funded by US State Department/MOST) • Five students at SLAC, each one year visit over next two years, first one arrived February 2005 • Jerrod & Les visited Pak, also DG NIIT visited SLAC, more visits planned • Mainly working on PingER management & visualization • To make it sustainable • Interest includes UN, ICFA, World Bank, ICTP, WIS, Internet 2 … • Also working on forecasting/prediction for DWMI
Support • SLAC increasingly multi program • BES: SPEAR3, LCLS; HEP; Astrophysics: Kavli, GLAST, LSST • New budgeting models for computing services • More program based, less overhead • Will increasingly need to provide direct funding for services used for MICS funded research
iGrid2005, SC2005 • Igrid2005 Sep 26-30, SC2005 Nov 12-15 • Collaboration for Bandwidth Challenge • CalTech, SLAC, CERN, FNAL … • Multiple booths • Multiple 10Gbits/s waves/lambda • Big bandwidth • Want to get applications • Large memory cluster (Richard Mount/Andy Hanushevsky) at SLAC or in StorCloud, with clients in booth • Lambda Station • Disk to Disk, would like 100Gbits/s BUT • Problems with amount of equipment, space, cabling, power, heat etc. let alone cost of equipment • Demonstrate monitoring etc.
Papers/presentations • Our work funded by DoE gets DoE visibility/recognition/respect worldwide, and helps promote research and commercial partnerships for continued research, investigations and funding: • Last 12 months • 10 published papers in reviewed journals • 20 presentations (NASA to the World Bank) • SC2004
Futures (funding permitting) • IEPM for >= 10Gbits/s hybrid networks • Forecasting for middleware/scheduling, problem detection, trouble shooting, develop/evaluate new measurement tools • Passive monitoring for high speed links • Provide network monitoring infrastructure to support critical HEP experiments • Engage in testbeds • USN, UltraLight, SC05, iGrid05, link to SLAC • Next Gen transport evaluation: • User space transport (UDT, Precision I/O), new TCP stacks, RDMA/DDP • Leverage skills/contacts to be “honest broker” • Industry contacts, testbeds, reputation, independence from developers/vendors etc.
Further information • IEPM-BW home page: • http://www-iepm.slac.stanford.edu/bw/ • Presentation on Event Detection: • www.slac.stanford.edu/grp/scs/net/talk05/escc-feb05.ppt • Paper/presentation on Transport evaluation: • www.slac.stanford.edu/grp/scs/net/papers/pfld05/paper10.doc • www.slac.stanford.edu/grp/scs/net/talk05/pfld-feb05.ppt • 10Gbits/s testing: • www.slac.stanford.edu/grp/scs/net/talk05/superg-apr05.ppt • SC04/Igrid2005 • www-iepm.slac.stanford.edu/monitoring/bulk/sc2004/hiperf.html • www-iepm.slac.stanford.edu/monitoring/bulk/igrid2005/hiperf.html • PingER results and Digital Divide report for ICFA, also I2: • www.slac.stanford.edu/xorg/icfa/icfa-net-paper-jan05/ • www.slac.stanford.edu/grp/scs/net/talk05/i2-members-may05.ppt
More Information • Status reports: • http://www-iepm.slac.stanford.edu/about/status/