ITS/CVO Architecture Conformance: Interoperability Testing Strategy Table of Contents

1. ITS/CVO Architecture Conformance:Interoperability Testing StrategyTable of Contents 1 Introduction 2 Terminology 3 Scope 4 Roles and Responsibilities 5 Test Environment and Tools 6 Test Process 7 Key Criteria Appendix A Level 1 Interoperability Test Matrix Appendix B Example of Interoperability Testing Status 4.1 Stakeholders 4.2 Who Does What Table of Contents The Johns Hopkins University Applied Physics Laboratory

2. Standard Test Developers/ Supporters APL Other Interoperability Testing Stakeholders FHWA CVISN Core Infrastructure Stakeholders OMCHS Other Stakeholders Federal Aid Credentials Administration/ Operations Information Requesters Regional Coalitions R & D Vendors Shippers Safety Administration/ Operations State Stakeholders Credentials Administration/ Operations Conformance Assessment Teams (COAT) Commercial Vehicle Industry Stakeholders Safety Administration/ Operations Motor Carrier Administration/ Operations Motor Coach Administration/ Operations Mobile Enforcement Owner/ Operators Drivers Roadside Enforcement Stakeholders The Johns Hopkins University Applied Physics Laboratory

3. Common Roles & Responsibilities for All Stakeholders • Verify that own products/systems are ready for interoperability testing • Define own product/system configuration for testing • Tailor test suite, as needed, to support tests involving own systems • Load test data • Execute tests on own products/systems • Evaluate results for own products/systems • Maintain configuration control over own products/systems, test environment, and test data • Execute tests again (regression test) as products are upgraded Who Does What The Johns Hopkins University Applied Physics Laboratory

4. Roles & Responsibilities Unique to Each Stakeholder Group • FHWA - Establish conformance criteria • State - Schedule, execute, and evaluate tests • CVISN Core Infrastructure System- Approve test results • Conformance Assessment Team (COAT) - Monitor test results • Commercial Vehicle Industry - Train users • Others - Train users Who Does What The Johns Hopkins University Applied Physics Laboratory

5. A Conformance Assessment Team (COAT) supports the Conformance Assurance Process for each project The project team is responsible for meeting development milestones The COAT makes sure the project conforms with the architecture and standards. • The COAT Includes: • State CVISN System Architect • FHWA Division Office ITS/CVO Specialist • FHWA Resource Center ITS/CVO Specialist • Architecture & Standards Expert State CVISN System Architect has dual role as part of the development team and leader of the COAT. Conformance Assurance Process The Johns Hopkins University Applied Physics Laboratory

6. The COAT checks for conformanceat each checkpoint Deployment Cycle Checkpoints COAT Task MOA & Requirements Definition Start Verify commitment to principles Review completed COACH Part 1 Project Planning, Review & Top-Level Design Definition Verify plan is sound and top-level design is consistent Review Project Plan & Top-Level Design Top-Level Design Detailed design for Phase“n” -Verify detailed design is consistent Detailed Design Review Detailed Design Interoperability Testing at end of Phase “n” - Test that systems meet standards and are interoperable Help Tailor Tests; Analyze Interoperability Test Results Implementation Test Conformance Assurance Process The Johns Hopkins University Applied Physics Laboratory

7. Roles & Responsibilities Unique to Standard Interoperability Test Developers/Supporters • Develop and maintain standard interoperability tests • Distribute standard test materials to other stakeholders • Support CVISN Test Facility • Develop • Maintain, schedule use of, and operate • Support test execution • Report test status, as required • Provide technical assistance to other testing stakeholders Who Does What The Johns Hopkins University Applied Physics Laboratory

8. APL Testing Team Develops Standard Interoperability Tests CVISN Interoperability Testing KS Smith Interoperability Interoperability APL Technical Test Test CVISN Review Engineering Operations Test Facility KS Smith BA Clyde BA Clyde KS Smith Technical Specialties Supporting Test & Technical Review Architecture Val Barnes DSRC Ron Char, Ray Yuan, Steve Severson EDI Karen Goldee, Mary Stuart Safety Info Exchange Brenda Clyde, Jim Polaha, Alan Mick, Joseph Sivilli Credentials Administration RL Waddell, Mary Stuart E-Screening Ron Char, Brenda Clyde, Wendy Chiu Who Does What The Johns Hopkins University Applied Physics Laboratory

9. FHWA supports the development and maintenance of the interoperability tests. States execute the tests Interoperability Test Suite Package Develop CVISN Test Facility JHU/ APL Define Interoperability Test Scenarios Define Test Cases and Procedures Develop Test Tools Develop Test Data Validate Tests in CVISN Test Facility Schedule Interoperability Tests Tailor Test Procedures and Data Execute Tests Evaluate Tests States & Carriers A&S Expert A&S Expert A&S Expert: An Architecture & Standards Expert provides support to help assess whether the system is in conformance. Schedule CVISN Test Facility Support Test Execution JHU/ APL The Johns Hopkins University Applied Physics Laboratory

10. The Johns Hopkins University Applied Physics Laboratory