680 likes | 716 Views
Performance Testing. Back to Basics May 2013. Who Am I?. Who Am I?. Who Are You?. Who Are You?. Performance testers?. Who Are You?. Performance testers Testers/QA?. Who Are You?. Performance testers Testers/QA Developers?. Who Are You?. Performance testers Testers/QA Developers
E N D
Performance Testing Back to Basics May 2013
Who Are You? Performance testers?
Who Are You? Performance testers Testers/QA?
Who Are You? Performance testers Testers/QA Developers?
Who Are You? Performance testers Testers/QA Developers CFR Cluj Supporters?
Today 4 sessions about an hour each Some practical work in groups Any questions/comments speak up Please share your thoughts/experiences
Performance Testing Back to Basics
What is Performance Testing? performance testing is in general testing performed to determine how a system performs in terms of responsiveness and stability under a particular workload? Wikipedia 2013
What is Performance Testing? Load Testing Stress Testing Soak Testing Spike Testing Configuration Testing Isolation Testing
Traditional Performance Testing understand the volumes Model the business processes Run experiments (tests) Measure performance indicators (response time, cpu etc.) Tune if needed Sign off report
Applications have changed More complex functionality Minimal defined business processes Diverse Public Internet Use of services (homegrown and third party) Cacheing Increased Client functionality (javascript etc.)
Applications have changed Cloud computing Multiple client platforms (tablet, mobile etc.) Push technology
Traditional Performance Testing Focus on IT/IS requirements Too difficult to model the entire application Length of time it takes to run a performance test Models have too many variables to be reliable Problems
As applications have increased in complexity and application usage has become more diverse we have developed new tools and approaches to help us predict and manage the performance of applications New Approaches to Performance
Synthetic testing (traditional perf testing) A/B testing Instrumentation/Analytics (RUM) React Fast Over_Provision Third Party tools New Approaches to Performance
Performance Testing Back To Basics
Rank Sites by Performance News related websites www.nytimes.com news.bbc.co.uk www.huffingtonpost.co.uk tv.msnbc.com www.cnn.com www.dailymail.co.uk
Rank Sites by Performance News related websites by response time news.bbc.co.uk (0.7) www.dailymail.co.uk (3.3) www.cnn.com (3.5) www.nytimes.com (3.9) tv.msnbc.com (5.5) www.huffingtonpost.co.uk (6.3) Gomez April 2013
Rank Sites by Performance News related websites by popularity www.cnn.com tv.msnbc.com www.nytimes.com www.huffingtonpost.co.uk www.dailymail.co.uk news.bbc.co.uk
The Five W's WHO?
The Five W's WHO? WHAT?
The Five W's WHO? WHAT? WHY?
The Five W's WHO? WHAT? WHY? WHEN?
The Five W's WHO? WHAT? WHY? WHEN? WHERE?
Who is interested in performance? IS/IT Department
Who is interested in performance? IS/IT Department Protection of production Stability Capacity Resource
Who is interested in performance? Customer
Who is interested in performance? Customer Stability (of Browser) Freezing Consistency Ease of use (fewest steps to get job done)
Who is interested in performance? Business
Who is interested in performance? Business Revenue Unique monthly visitors Conversion rates Site Abandonment rate
Who is interested in performance? As Application complexity has increased so too has the amount of performance related information available As a performance tester it is important to be able to interpret the data and be able to present information that is useful and relevant to people.
Test models Choose 2 key business processes for each site www.amazon.com www.lastminute.com www.digitalspy.co.uk
Test models Choose 2 key business processes for each site www.amazon.com
Test models Choose 2 key business processes for each site www.lastminute.com
Test models Choose 2 key business processes for each site www.digitalspy.co.uk
What to Test? Information used to prioritize testing
What to Test? Information used to prioritize testing New technology Heavy usage Spikes in usage Key revenue generators Customer goals (or hot buttons)
What to Test? As it has become harder to model and test an entire application, being able to identify which areas of an application are key for performance is now more important than ever