300 likes | 393 Views
From Design to Production. Practicing what we preach at HP Shane Evans – Product Manager Oded Keret – Functional Architect. Modern App Lifecycle. Virtualize Services for ease of deployment. Design. Monitoring. Capture Real User behavior/conditions. Develop. Reuse Unit Tests throughout.
E N D
From Design to Production Practicing what we preach at HP Shane Evans – Product Manager Oded Keret – Functional Architect
Modern App Lifecycle Virtualize Services for ease of deployment Design Monitoring Capture Real User behavior/conditions Develop Reuse Unit Tests throughout Delivery Performance Reuse test scripts for monitoring Functional/UX Leverage virtual services and network for realistic results Security Automate test execution and analysis
Build Commit Test Code CI System Flow • TruClient Service detects new build available 1. Execute relevant test bundle 2. Report results • Build: • Get latest code • Compile • Run Unit tests • Verify • Deploy • Run Automation tests Code Report
Core Bundle – quick execution • Execute a small bundle of scripts to test only core functionalities. • Launching multiple browser processes (IE/FF/Chrome) to execute all scripts in a short time (200 scripts in under 3 minutes) • We can easily scale up more browsers to reduce test time • Bundle is executed for each code change Core
Core Bundle Core
Nightly Bundle • Execute a large number of scripts to cover the entire product (UI, API,Core, and more). • Bundle is executed every 3 hours (time interval can be configured). • Can launch multiple browser processes (IE/FF/Chrome) to execute all scripts in a short time Nightly Coe
Nightly Bundle Nightly Nightly
Performance Bundle • Execute 1 Vuserscenario for FF, IE and Chrome to take footprint measurements • Script runs iteratively for 2H in each browser, to make sure we have no leaks. • Repeat for 51 concurrent Vusers, to make sure performance scales up as expected. Performance
Performance Bundle Performance Performance Footprint
Performance Bundle Performance
Single user performance is nice.But how would you scale up? • Introducing StormRunner Load Just Load
AUT #2 – HP StormRunner Load Results and Analysis are displayed in real time Load is Generated from multiple Geographies Load Generators are provisioned per Load Test User creates and executes Load Test AUT is monitored by HP SiteScope Application Under Test
Introducing: StormRunner Simple. Fast. Scalable.
"Build it, test it, and fix the things that go wrong. Repeat the process until the desired reliability is achieved.It is a feedback process and there is no other way." David Packard July 1972