1 / 10

Benchmarking Methodology WG (bmwg) 63rd IETF – Paris, France

This document provides the agenda for the Benchmarking Methodology Working Group (bmwg) 63rd IETF meeting held in Paris, France on August 2, 2005.

htravis
Download Presentation

Benchmarking Methodology WG (bmwg) 63rd IETF – Paris, France

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Benchmarking Methodology WG (bmwg)63rd IETF – Paris, France • Tuesday, August 2, 2005, 1030-1230 • Chairs: • Kevin Dubray (kdubray@juniper.net) • Al Morton (acmorton@att.com) • If you are not subscribed to the BMWG mailing list and would like to be, put an asterisk (*) by your name when you sign the blue attendance sheet.

  2. BMWG Agenda • Note-Taker(s), IPR, and Blue Sheets • WG Status and Liaison notes (Chairs, 20 min) • Milestones Status (Chairs, 5 min) • Resource Reservation Terminology I-Ds. (Korn, 15 min) • IPsec Benchmarking Terms (& intro to methods) (Kaeo, 15 min) • Core Router Accelerated Life Testing I-Ds (Poretsky, 15 min) • Revised Charter Text (Chairs, 15 min) • New Work

  3. BMWG Activity • AD/IESG Review • this space is blank for now • WG Last Call • <draft-ietf-bmwg-benchres-term-06.txt>, Back to AD review? • <draft-ietf-bmwg-igp-dataplane-conv-term-07.txt> Need to revise? • <draft-ietf-bmwg-igp-dataplane-conv-meth-07.txt> Need to revise? • <draft-ietf-bmwg-igp-dataplane-conv-app-07.txt> Need to revise? • <draft-ietf-bmwg-dsmterm-11.txt>, additional WGLC needed. • <draft-ietf-bmwg-ipsec-term-06.txt> WGLC, comments • I-Ds • <draft-ietf-bmwg-fib-meth-03.txt>, No change • <draft-ietf-bmwg-hash-stuffing-03.txt> WGLC requested. • <draft-ietf-bmwg-acc-bench-term-06.txt> Ready for WGLC? • <draft-ietf-bmwg-acc-bench-meth-03.txt> Ready for WGLC?

  4. BMWG Activity • I-Ds • <draft-ietf-bmwg-acc-bench-meth-ebgp-00.txt>, new • <draft-ietf-bmwg-acc-bench-meth-opsec-00.txt>, new

  5. BMWG Activity • Expired BMWG I-Ds • <draft-ietf-bmwg-bgpbas-XX.>, • <draft-ietf-bmwg-benchres-method-00.txt> Pending term • New Work proposals. • LDP Convergence – expired, but… • draft-poretsky-protection-term-00.txt (adopt?) • draft-poretsky-mpls-protection-meth-04.txt (adopt?) • RFC Editor – none. • Charter Update • Need to adjust. • New RFC: • RFCs 4061, 4062, 4063 on OSPF convergence benchmarking. • RFC 4098 on BGP convergence terminology

  6. 802.11T - BMWG Liaison • Detailed note from Tom Alexander posted to BMWG mail archive. • 5 proposals for metrics & methods (mostly RF) identified at San Francisco meeting; 2 were accepted. • Proposals to be integrated into a draft update.

  7. Current Milestones Status Past Due Milestones • Dec 04 IPsec Device Benchmarking Terminology to AD Review • Apr 05 Net Traffic Control Benchmarking Terminology to AD Review • Apr 05 Methodology for FIB related Router Perf. Bench. to AD review. • Apr 05 IGP/Data-Plane Terminology I-D to AD Review • Apr 05 IGP/Data-Plane Methodology and Considerations I-Ds to AD Review • Apr 05 Router Accelerated Test Terminology I-D to AD Review • Jul 05 Basic BGP Convergence Benchmarking Methodology to AD Review. On Track • Oct 05 Router Accelerated Test Method. and Consid. I-Ds to AD Review • Oct 05 Hash and Stuffing I-D to AD Review (added!) • Dec 05 Net Traffic Control Benchmarking Methodology to AD Review. New • <draft-ietf-bmwg-acc-bench-meth-ebgp-00.txt>, • <draft-ietf-bmwg-acc-bench-meth-opsec-00.txt>

  8. Charter Text • Central Tenet • Notion of a “Benchmark” • BMWG Benchmark: • A prescribed measurement that’s a basis for performance evaluation AND comparison.

  9. Benchmark: Required Attributes? • Relevant and meaningful. • Unambiguous specification of an attribute (or attributes) being examined, its collection and reporting. • Universal applicability within class. (No bias toward or against a specific implementation.) • Repeatability.

  10. What BMWG benchmarks are not (or cannot be) • Conformance tests • IESG mandated • Acceptance tests • Implication of success criteria • Practical mandate • Operational tests • Division of Labor between other organizations.

More Related