180 likes | 322 Views
Joint Exchange / Interop Work Group Test Workgroup. John Donnelly /Judith Huntman /Joe Lamy. Aug 15, 2012. Roll. Agenda. Roll Call – Cayla Announcements – Eric Review of Phases – Judith (10 mins ) Vote on Harmonized Phase I Test Cases – John (10 mins )
E N D
Joint Exchange / Interop Work Group Test Workgroup John Donnelly/Judith Huntman/Joe Lamy Aug 15, 2012
Agenda • Roll Call – Cayla • Announcements – Eric • Review of Phases – Judith (10 mins) • Vote on Harmonized Phase I Test Cases – John (10 mins) • Execution of Test Cases – Judith/Joe (10 mins) • Test Case Metrics – Judith/Joe (7 mins) • Open Discussion – All • Wrap Up - John • Schedule Review - John
Announcements • Harmonized PD/QD/RD/MP/AF (aka Patient Record Lookup) Tests Are Ready for Vote! • Future changes are possible, but will be incorporated into the next phase of test cases design and implementation (post Oct 2012) • RFP • Has 5 respondents • Contracting is expected to begin this week
Harmonization Phases Unified Test Process – Has Been Proposed
Vote on Harmonized Artifacts • PD, QD, RD, Messaging & Auth (Phase I) • Vote to ratify this workgroups decision that the current written test cases for PD, QD, RD, MP, AF (aka Patient Record Lookup) are in “final” status • ‘round-the-room vote: • Approve • Abstain – with reason stated • Do not approve • Artifacts may be found at: http://exchange-iwg.wikispaces.com/Test+Artifacts+Harmonization
Direct Harmonization: Deployment Models • Deployment models: • EHR-HIE Test Spec identifies actors: assumes specific deployment models • ONC Test package: agnostic • Direct Project specifications do not specify a model • Issues: • Specifying a deployment model may restrict testing or add requirements outside the scope of the specs • Solution: • Present EHR-HIE Test Spec deployment models and actors as examples of implementation models • Map EHR-HIE Test Spec deployment models to our use cases • Show the outliers (what they are testing that is not in our scope)
Harmonization: Modular Approach (PD-QD-RD) End User Auth PD QD RD Messaging & Auth Message Render TC1 MR1 MR2 TC2 TC1 TC2 PD1 PD2 QD1 QD2 RD1 RD2 TC3 PD3 QD3 MR3 TC3 RD3 Event-Based Interop Testing EHR-HIE ApplicantProduction Participant TC1 MR1 TC1 TC2 PD1 QD1 MR2 RD2 PD2 TC2 TC3 MR3
Harmonization: Modular Approach (Direct) End User Auth Direct Messaging Cert Discovery Deplmnt B Reqts Deplmnt A Reqts Message Render Deplmnt X Reqts X1 MR1 A1 B1 MR2 B2 X2 A2 TC1 TC2 DM1 DM2 CD1 CD2 TC3 DM3 CD3 B3 X3 MR3 A3 Event-Based Interop Testing EHR-HIE ApplicantProduction Participant A1 MR1 TC1 TC2 DM1 CD1 MR2 DM2 CD3 A2 TC3 MR3 DM3 CD2 A3
Automating Test Case Execution Messaging & Auth • Modular: New scripts for each web service • Some test cases implicitly covered by test cases in core specs • Testing invalid SAML assertions • Critical to exchange security • Probably can’t be executed using CONNECT as test tool
Automating Test Case Execution Direct • NIST: Direct messaging tool in development • ONC Test: Prototype Direct Cert Discovery tool • September 2012: Incorporated into NIST/ONC-Cert MU2 Test Procedures
‘round-the-room What risks or other concerns do you have at this point in the process related to the harmonized test cases or automation approach?
Schedule Review • RFP released — July 2nd • Questions received by 6 organizations • Answers distributed — July 13th • Bids due — July 20th • Expected award — August 15th • Contract start — TBD We are here