1 / 24

Load and Performance Testing

Load and Performance Testing. Web Performance and Load Testing has been enhanced with the 2010 release .

dobry
Download Presentation

Load and Performance Testing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Load and Performance Testing Web Performance and Load Testing has been enhanced with the 2010 release. Performance testing is no longer a “nice to have” testing process in a world where end users expect a lot more from the performance of applications . Visual Studio 2010 Ultimate provides the ability to create and customize load testing to test the performance of applications. In this session, requirements for installation and configuration of test agent will be discussed and demonstrated. I will also create web performance and load tests using Visual Studio 2010 Ultimate. Randy Pagels Sr. Developer Technical Specialist Microsoft Corporation rpagels@microsoft.com www.teamsystemcafe.net Achieve high levels of concurrency by testing often and testing early…

  2. What is a load test? • An automated collection of tests run in parallel to simulate multiple users or systems • Load tests run software unit tests, database unit tests, and web performance tests • Visual Studio captures details metrics while the load test runs

  3. Load Testing Flexible Load Modeling • Enables easily simulating different user groups • Goal-based, step, constant, and custom load patterns • Model different browsers and networks Efficient Load Generation • Minimal hardware investments • Scale-out load generation Integrated and Extensible Data Collection • Performance Counter Sets capture key measurements • Primary counters identified for key technologies • Thresholds bake in guidance on counters • Test results stored in SQL for custom reporting • Data collectors allow custom log capture

  4. Load Test Concepts Scenario • A collection of load test parameters that simulate real world scenario. Load Pattern • Determines the number of users the scenario simulates. May be constant or stepped to simulate an increasing number of users Test Mix • Determines the unit tests and web tests. Network Mix • Determines the connection speeds used by virtual users Run Settings • A set of properties that determine the way the load test runs

  5. Load Test Licensing Changed • Changing to virtual user license • Offers more flexibility in agents • Enables better purchase planning • Helps us monetize load

  6. Network Emulation • Productizing NEWT network device driver • Throttles bandwidth, introduces latency and errors at the network layer • Scenarios • Single user testing over slow network • Automated performance testing over slow links

  7. Installing Test Controller & Agents Test Controller • Must be a member of the Admin security group • Installed from the Agents DVD • Configure Test Controller for Load Testing • SQL Server Instance • Manage Virtual User Licenses Test Agent • Run as a Service or Interactive Process • Member of Admin security group • Configure Test Agent • Run as an Interactive Process • Register with Test Controller

  8. Configuring Test Settings Test settings can be configured for load tests to enable distributing the load test across multiple machines by using test agents and test controllers Set in TestSettings Configuration • Roles • Data and Diagnostics • Deployment • Setup and Cleanup Scripts • Hosts • Test Timeouts • Unit and Web Test • Tier Interaction

  9. Core Scenarios • Single user performance testing • Create and debug Web Performance Tests • Use Coded UI tests to measure end user performance • Run performance tests • Analyze results • Report to stakeholders • Fix the problems using the profiler

  10. Load Modeling • “Scenarios” for modeling different user groups • Step, goal-based, constant, and custom load patterns • Duration-based and iteration based • Ability to simulate different browsers and networks

  11. Integrated Diagnostics • Out of Box integration with ASP.NET Profiler • Integration to JAVA application diagnostics via Dynatrace • Event log, Network Emulation and and other collectors Microsoft Confidential

  12. Defacto Load Tool in Microsoft

  13. Web Performance Test Recorder Visual Studio Launches Internet Explorer RecorderListener Merging Recorder Browser Recorder Wininet Recorder Internet Explorer Visual Studio Recorder BHO Browser events Record events Browser Control Wininet Shim Record events Wininet Record events Intercepts wininet calls

  14. Web Test Recorder Plugin WebTestRecorderPlugins Visual Studio Launches Internet Explorer RecorderListener Merging Recorder Browser Recorder Wininet Recorder Internet Explorer Visual Studio Recorder BHO Recorded Web Test Browser events Record events Browser Control Wininet Shim Recorder Result Wininet Record events Intercept s wininet calls Record events

  15. Load Test Agent Architecture VS 2010 Ultimate Unlimited Load Test Virtual Users Test Controller Agent Agent Agent Agent Collect ASP.NET profiler traces Target Server Target Server Collector Agent Target Server

  16. Load Analysis & Extensibility • Performance Analysis • Server activity with performance measurements • Drill into error logs • Excel Performance reports • Visualize virtual user activity • Drive any test type under load • Create custom test types • Develop recorders to generate unit tests • Many extensibility points in Web tests • Plugins allow control of nearly all aspects of the load test • ASP.NET profiler integration • Database TIER Profiling

  17. Run Performance Report Load Test Analysis Built into Excel for run comparison

  18. Run Performance Report – Compare Runs Load Test Analysis for Baseline Runs

  19. Run Performance Report - Trends

  20. Multi-Tier Performance Analysis B Shows number of times the page was request along with Total, Min Max, and Avgtime spent on processing the request A Use wizard to enable T.I.P. Total, Min, max, and avgtime spent executing that query D Show actual query generated C

  21. Load & Performance Testing Web test recorder Load testing Profiler Integration

  22. Visit Team System Café for… • Freshly brewed news • Upcoming events • Download links • Practical tips to go • Download Visual Studio 2010 Trials • http://tinyurl.com/ycfbfyo • Get Started with Lab Management • http://tinyurl.com/394nyfe http://www.teamsystemcafe.net

  23. Test Manager 2010 UML Modeling Performance Profiling Manual Testing Layer Diagram Load Testing Web Testing Test Case Management IntelliTrace™ Architecture Explorer Logical Class Designer Cloud Development Office Development Windows Development New WPF Editor Customizable IDE Multi-core Development Silverlight Tools Web Development SharePoint Development Generate from Usage Static Code Analysis Database Deployment Code Metrics Database Unit Testing Test Data Generation Test Impact Analysis UI Test Automation Code Coverage Database Change Mgmt Fast Forward for Manual Testing

  24. Test Manager 2010 Gated Check-in Test Case Management Manual Testing Lab MgmtConfig. Checkpoint Environment Environment from Template Virtual Env. Setup/Tear Down Team Explorer Team Agents Reporting Team Portal Test Case Management Branch Visualization Version Control Build Automation Agile Planning Tools Fast Forward for Manual Testing

More Related