Scaling and extending Windows assessments to improve system quality: Part 1

1. HW-148P Scaling and extending Windows assessments to improve system quality: Part 1 Patrick Azzarello Senior Program Manager Windows Ecosystem Fundamentals Microsoft Corporation

2. Agenda • Assessment project goals and history • Tools and components • A walkthrough of how the process works and how it scales

3. Assessment Project Goals and History

4. Partners and customers want to assess and improve Windows system quality, and want Microsoft’s help to do so

5. Assessing and Improving System Quality • Previous assessment efforts were successful, but: • Distribution was very limited • Required additional training • Hard to support and service • Internal tests have their own challenges • Quantity: A huge number of tests exist internally • Expertise: Tests are intended for team testing, not external testing • Scope: Usually VERY specific • Dependencies: Internal dependencies must be broken or resolved in the “right” way

6. Project Goals: • System Quality Assessments should: • Focus on assessing the end-users experience, not just the underlying technologies • Assess system quality in a quantifiable way • Allow for system comparisons • Identify issues and provide remediation steps wherever possible • Provide the ability to dig deeper using tools like Windows Performance Analyzer • Make collaboration easier • Be widely available

7. Windows Assessment Toolkit

8. Components

9. What You Get in the Windows ADK • Remediation tool used for analysis of performance traces WPA Windows Performance Analyzer Used to access, configure, create, save, package jobs to run on different machines. Good for running assessments on one to a few machines. Used to view results from assessment run Scenario-based tests of system quality, delivering metrics, identifying issues, and providing remediation steps wherever possible ADK Assessment and Deployment Kit WAC Windows Assessment Console Assessments WAS Windows Assessment Services Used for larger environments with the potential of running assessments on hundreds of computer

10. The Assessment Process

11. demo Running an Assessment within the Windows Assessment Console Patrick Azzarello Senior Program Manager Windows Ecosystem Fundamentals

12. Assessment Infrastructure: Architecture ASMTResources ASMT MFest Asmt Resources Assessments Object Model Job MFest ASMT MFest WAC Configuration Package Run View

13. Packaging an Assessment Job Package Job Mfest+ Job MFest Modify Paths Asmt A Asmt A Asmt B Asmt B AL.EXE AL.EXE Asmt C Asmt D AXE.EXE AXE.EXE Asmt D Job Mfest+ Arch Script Arch Script start “Package\%PROCESSOR_ARCHITECTURE%\AL.exe" “MyJob.xml" start “Package\X86\AL.exe" “MyJob.xml"

14. Assessment Infrastructure: Architecture ASMTResources ASMT MFest Asmt Resources Assessments Object Model Job MFest ASMT MFest WAC Configuration ASMT Resources Job Package Arch Script Job MFest Tools Package Job Package Results File Arch Script Run View

15. Assessment Infrastructure: Architecture ASMTResources ASMT MFest Asmt Resources Assessments Object Model Job MFest ASMT MFest WAC Configuration ASMT Resources Job Package Arch Script Job MFest Tools Package Job Package Results File Arch Script Run Object Model View in WAC Results File View Import to Database

16. Wrap Up • Assessment project goals and history • Tools and components • A walkthrough of how the process works and how it scales Recommended: Watch Part 2 of this video presentation for more information on how to extend or customize this technology to integrate it into your own environment.

17. For more information RELATED SESSIONS DOCUMENTATION & ARTICLES • HW-148P Scaling and extending Windows assessments to improve system quality Part 2 • HW-147T Building high quality Windows PCs using the assessment and deployment kit • HW-915P Introduction to assessments • HW-59T Improving performance with the Windows Performance Toolkit • HW-61H Experiencing the assessment tools in Windows 8 CONTACT

18. thank you Feedback and questions http://forums.dev.windows.com Session feedbackhttp://bldw.in/SessionFeedback

19. © 2011 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.