370 likes | 583 Views
Section 508 Testing. Gettysburg 2009. Presentation Topics. Section 508 Testing Principles Process Development Testing Tools Testing Process Results Reporting Governance Section 508 Training Customs and Border Protection US Citizenship and Immigration Services. Testing Principles.
E N D
Section 508 Testing Gettysburg 2009
Presentation Topics • Section 508 Testing • Principles • Process Development • Testing Tools • Testing Process • Results Reporting • Governance • Section 508 Training • Customs and Border Protection • US Citizenship and Immigration Services
Testing Principles • 508 standards-based testing, not AT • Software and Web go together • Reliable test results • Document procedures • Easy to use testing tools • Minimize subjective outcomes • Document results • Repeatable by other testers • QA vs. IV&V
Application Testing Development • Automated Testing Tools - none • Manual Testing Tools • Web Accessibility Toolbar (WAT) • JAWS • Object Inspector • Java Ferret • Developed Testing Script (for Windows XP)
Testing Tools Web Accessibility Toolbar • IE plug-in • http://www.paciellogroup.com/resources/wat-ie-about.html
Testing Tools Update JAWS • Assistive Technology, not a testing tool • Inaccurate 508 testing results • Steep learning curve • JAWS scripts seek information • JAWS functionality varies by version • Object Inspector overrules • JAWS compatible ≠ 508 compliant
Object Inspector • Microsoft Active Accessibility (MSAA) • Test Software standards • SW (c) – focusable (state) • SW (d) – identity (name), operation (role), state • SW (f) – text information (value) • SW (l) – form labels (name) • http://www.microsoft.com/downloads/details.aspx?familyid=3755582A-A707-460A-BF21-1373316E13F0&displaylang=en • Java Ferret for JAVA Apps
Testing Tools Update Web • WAT • Internet Explorer Software • Object Inspector • Java Ferret • JAWS removed No more JAWS testing?? Yay!
Script 1.0 SW script (12) Web script (16) In order of standards a, b, c, … Not logical Duplicate standards Script 2.0 SW+Web script (14) Rich Web apps Keyboard access Element based Interactive elements Non-text elements Identify SW or Web? Testing Script Update
Testing Script Excerpt • Interactive Elements • Keyboard access • Visual Keyboard focus • Labels for Assistive Technologies • Forms (SW, Web) • Scripts (Web) • Non-Text Elements • Images (SW, Web) • Animation (SW) • Audio or Video files (Web) • Image Maps (Web)
Testing Reports • Report Cover • Application details (URL, COTS, version) • Functions tested (login, search, navigation) • Results (which standards failed) • Report Details • Explain failures and cite examples • Based on Sample Testing • Impact Guide
What to do with Test Results? • Examples of governance activities include • Enterprise architecture reviews • Change control • Ready-to-test review
Multi-agency Implementation • Must train testing personnel • Must ensure testing requirement in acquisition contracts • Must ensure testing results are integrated into governance process
Testing Training • Testing Applications and Websites for Accessibility • Hands-on • Two days • Instructor led • 259 DHS personnel trained • Follow-up support
Recipe for Success • Lifecycle • Standard Testing • Training
Section 508 Testing in CBP • Implemented within the: • Technology Insertion Process • Architecture Alignment and Assessment (AAA) Process
CBP Technology Insertion Process *Recently added to the TI Process (May 2009) • Receive TI Requests (COTS Products) • New Technology or Major Version Upgrade • Section 508 testing completed by CBP Enterprise Testing Team • Section 508 team makes recommendations to CTO’s office • TRC and ARB make final decision
Difficulties Integrating 508 Testing • Adequate Buy in from Upper Management • Importance of 508 Testing • Staff/Support for 508 Testing
Educating our Testers • Currently utilizing the CBP Enterprise Testing Team for 508 Testing • All testers are required to take the OAST Testing Applications and Websites for Accessibility training • Continuous assistance from OAST to ensure testing is accurate
Eliminating JAWS • There may be some minor pushback • Some testers appreciate eliminating JAWS since there will be one less step to perform • New testers are not aware of the older method
Benefits for Integrating 508 testing • Importance of 508 is heightened • Consideration of eliminating failed products from the TRM • Projects becoming more aware to include 508 in project implementation
Challenges • Training and awareness of what documentation is necessary for 508 reviews (from product requestors) • Initial 508 results taken lightly • Employee turnover = ensuring new employees are trained and made of aware of section 508 compliance
Measuring Success • Currently - continue to test all product requests • Receiving feedback from requestors and Chief Technology Officer regarding testing results - what should they do? • Future – Continue to educate about Section 508 so testing is seamless throughout all CBP processes.
Educating Industry • In coordination with OAST- developed vendor letter if product chosen is not 508 compliant. • Working with procurement for pushback on vendor if products are not 508 compliant.
Section 508 Testing at USCIS • Section 508 fully integrated into USCIS IT Lifecycle Management (ITLM) • IT Document Library • D&F Form • Market Research Report • Section 508 Test Document • COTS/GOTS Workflow • Custom Development Workflow • Developer testing verified by Independent testers
USCIS Section 508 Test Documents • Introductory Material -- who, what, when, and why • Standard test tools • Roles and responsibilities • How to conduct COTS market research • Test-Specific Scope • 508 product categories • Tasks/pages to be tested • Test tools/methods used with justifications for selection
USCIS Section 508 Test Documents • Standardized Procedures for Testable Standards • Software Applications and Operating Systems • Web-based Applications • Self-contained and Closed Products • Information, Documentation and Support • Test Results • Summary of builds tested, dates, and outcomes • Functional Performance Criteria Matrix (disabilities impacted) • Section 508 Test Problem Reports (TPR)
“Solved” Section 508 Test Challenges • Projects now regularly employ a Project Tailoring Plan • Projects no longer approach ITLM for test review without prior engagement and claim 508 “ignorance” • Projects are not asking for “baseline” 508 testing to determine their status for repair in next release • Some Legacy systems plan for testing new code for compliance and others seek to employ the long term solution of the USCIS Transformation (TPO) • Progress recently made in acquisitions plans to require documentation of Market Research in a D&F form prior to purchase
USCIS Section 508: 101 Training • Tailored to specific processes at USCIS • Eight hours of training, offered once per month, beginning May 2009 • Intended audience • Testers • IT project managers • Acquisition • Application designers and developers • Quality assurance • Purpose • Overview of Section 508 categories, standards, and exemptions • How 508 fits into ITLM • How to conduct market research • How to complete a D&F Form for items assessed during market research and tested for compliance • Certification exam