270 likes | 439 Views
Customer Experience Management (CEM) Bonny Brown, Ph.D. Director, Research & Public Services. © 2004 Keynote Systems. Customer Experience vs. Usability. Web sites - part software, part marketing medium Usability is a subset of customer experience
E N D
Customer Experience Management (CEM) Bonny Brown, Ph.D. Director, Research & Public Services © 2004 Keynote Systems
Customer Experience vs. Usability • Web sites - part software, part marketing medium • Usability is a subset of customer experience • Usability – Can users use it? How can we make it easier? • Customer Experience – Do users like it? How can we better drive conversion, loyalty, and brand? • Areas for Customer Experience insights: • Customer needs, preferences • Barriers to adoption • Drivers of retention and loyalty • Concept testing of new features • Feedback and impact of policies • A/B Testing to make volume predictions
Research Phases • Discover: Define strategic direction • Business objectives • Core business metrics (sales, leads, traffic, support center data) • Competitive assessment / benchmarking (baseline) • Drivers / Customer insight • Segmentation • Explore: Develop concepts and assess user reactions • User interaction / reaction • Unanticipated insights / obstacles / opportunities • Evaluate: Refine and perfect solution • Predict user response to implemented solution, prove product success before launch • Track: Set goals and monitor success • Competitive assessment / benchmarking (ongoing) • Optimization
Metrics to Manage Customer Experience Customer Needs Keynote Syndicated • Metrics to measure progress • Strategic direction • Understand relative strengths and weaknesses • In-depth customer feedback • Actionable recommendations and best practices • Affordable research • Ongoing success metrics • Driver analysis • Apples-to-apples comparison to competitors • Attitudes and behaviors reveal “why’s” • Analysis conducted by experts • Multi-client study reduces research cost per client
The Complete Customer Experience Advertising PreviousExperience Word of Mouth Continuous Measurement and Improvement Thoughts + = Expectation Interaction Customer Experience Impact Behavior What do users think about you? How do they expect to be treated? What do theywant to do? Are yourcustomers: Engaged? Frustrated? Confused? Why? • Customer Conversion • Brand • Retention • Productivity • Customer Service • Revenue Maximization What do users do? What are they thinking? Do they succeed?
CUSTOMERSATISFACTION INDEX BRANDIMPACTINDEX CONVERSION INDEX Success Indices and Drivers OVERALL CE RANKINGS (Overall site effectiveness based on equal weighting across each of the three indices) DRIVER ANALYSIS (Aspects of the experience are grouped into factors and then regressed against the indices to identify factors most related to brand and conversion) SITE EXPERIENCE METRICS (250+ quantitative metrics gathered per site)
Traditional Methods Customer Experience Intuition Focus Groups Usability Log ServerAnalysis Web-based Surveys Robotic Agents
Integrate the Best of Each Method Users Intent Known Large Samples Qualitative Data Behavior Data Natural Setting Analysis Tools Keynote Focus Groups Usability Labs Surveys Traffic Analysis
How Keynote CEM works ..using our browser companion that captures events Panelists are invited or intercepted… …to evaluate site(s) …which are analyzed with our powerful software …providing comments and feedback …performing tasks & answering questions “Find information that meets your needs.” “How satisfied are you with this site?”
Canon vs. Xerox • The “client,” Canon, turned to Keynote to evaluate Customer Experience on the Canon.com website… • Home Page • Product Search Capabilities • Online Customer Support Options • …benchmarked against top competitor site, Xerox.com
Study Participants • A large sample of target and actual customers participated in the evaluation: • 800 panelists from the Keynote Research Panel • Majority of panelists significantly involved in purchasing printers, fax machines and copiers for company • 37% of panelists actual Canon customers …providing credible Customer Experience data
Customer Insight Insight Poor Customer Experience on the Canon.com website is resulting in lost revenue Canon.com site is cluttered and difficult to navigate Customers find search engine unhelpful Inadequate product information is provided for customers to evaluate products As a result, customers can’t find products that meet their needs on the site
Panelists commonly describe Canon homepage as “busy” and “cluttered” compared to “clean” Xerox homepage
Panelists comments reveal that homepage does not provide clear navigation to product information
Panelists took very scattered paths trying to find product Majority of panelists failed or gave up product search on Canon.com
In contrast, the majority of panelists succeeded in product search on Xerox.com!
The majority of panelists used the search engine on Canon.com…
…and 99% encountered problems with Canon.com’s search engine!
80% of panelists did not find adequate product information to select a product on Canon.com
Product Search 80% of all panelists were unable to find a product on Canon.com
Panelist provides detailed description of frustrations on Canon.com
Spent over 8 minutes • Couldn’t find the product • Rated Canon.com “Extremely Difficult”
Only panelists who authorize purchases of faxes, printers and copiers Poor Customer Experience is costly!
Canon vs. Xerox Actionable Recommendations Improve ease of finding products: • Create clearer product classification categories for browsing customers • Categorize search engine results • Expand product information Impact Increase transactions volume and revenue
Conclusions • Web customer experience is a combination of excellent application design and marketing • Customer Experience research needs to: • Capture the complete Web experience • Explain the “Why” behind the “What” • Combine the best of multiple methods • New tools and methods allow better insight into how to improve the customer experience and the bottom line