1 / 19

Performance Assessment Min Song, Ph.D. Is 465

Performance Assessment Min Song, Ph.D. Is 465 LEARNING OUTCOMES 4.1 Compare efficiency IT metrics and effectiveness IT metrics 4.2 List and describe five common types of efficiency IT metrics 4.3 List and describe four types of effectiveness IT metrics

benjamin
Download Presentation

Performance Assessment Min Song, Ph.D. Is 465

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Performance Assessment Min Song, Ph.D. Is 465

  2. LEARNING OUTCOMES 4.1 Compare efficiency IT metrics and effectiveness IT metrics 4.2 List and describe five common types of efficiency IT metrics 4.3 List and describe four types of effectiveness IT metrics 4.4 Explain customer metrics and their importance to an organization

  3. Key Terms • Efficiency: doing things the right way • Effectiveness: doing the right things • Equality: doing things fairly

  4. CHAPTER FOUR OVERVIEW • Efficiency and effectiveness IT metrics are two ways to measure the success of IT strategic initiatives • Efficiency IT metrics – measure the performance of the IT system itself including throughput, speed, availability, etc. • Effectiveness IT metrics – measure the impact IT has on business processes and activities including customer satisfaction, conversion rates, sell-through increases, etc.

  5. BENCHMARKING – BASELINING METRICS • Benchmarks – baseline values the system seeks to attain • Benchmarking – a process of continuously measuring system results, comparing those results to optimal system performance (benchmark values), and identifying steps and procedures to improve system performance

  6. THE INTERRELATIONSHIPS OF EFFICIENCY AND EFFECTIVENESS IT METRICS • Efficiency IT metrics focus on technology and include: • Throughput – amount of information that can travel through a system at any point in time • Speed – amount of time to perform a transaction • Availability – number of hours a system is available • Accuracy – extent to which a system generates correct results • Web traffic – includes number of pageviews, number of unique visitors, and time spent on a Web page • Response time – time to respond to user interactions

  7. THE INTERRELATIONSHIPS OF EFFICIENCY AND EFFECTIVENESS IT METRICS • Effectiveness IT metrics focus on an organization’s goals, strategies, and objectives and include: • Usability – the ease with which people perform transactions and/or find information • Customer satisfaction – such as the percentage of existing customers retained • Conversion rates – number of customers an organization “touches” for the first time and convinces to purchase products or services • Financial – such as return on investment, cost-benefit analysis, etc.

  8. THE INTERRELATIONSHIPS OF EFFICIENCY AND EFFECTIVENESS IT METRICS • Security is an issue for any organization offering products or services over the Internet • It is inefficient for an organization to implement Internet security, since it slows down processing time. However, to be effective it must implement Internet security. • Secure Internet connections must offer encryption and Secure Sockets Layers (SSL denoted by the lock symbol in the lower right corner of a browser)

  9. THE INTERRELATIONSHIPS OF EFFICIENCY AND EFFECTIVENESS IT METRICS • The interrelationships between efficiency and effectiveness

  10. Evaluating Efficiency-Effectiveness-Equality Trade-Offs: A Data Envelopment Analysis Approach Boaz Golany, Eran Tamir Management Science, Vol. 41, No. 7 (Jul., 1995), pp. 1172-1184

  11. BENCHMARKING – BASELINING METRICS • E-governement benchmarks for IT efficiency and effectiveness

  12. DETERMINING IT EFFICIENCY AND EFFECTIVENESS • Customer metrics – assess the management of customer relationships by the organization and include: • Market share • Customer acquisition • Customer satisfaction • Customer profitability

  13. Web Traffic Analysis • Most companies measure the traffic on a Web site as the primary determinant of the Web site’s success • However, a large amount of Web site traffic does not necessarily equate to large sales • Many organizations with high Web site traffic have low sales volumes

  14. Web Traffic Analysis • Web site traffic analysis can include: • Cookie – a small file deposited on a hard drive by a Web site containing information about customers and their Web activities • Click-through – a count of the number of people who visit one site and click on an advertisement that takes them to the site of the advertiser • Banner ad – a small ad on one Web site that advertises the products and services of another business, usually another dot-com business • Interactivity – visitor interactions with the target ad

  15. Behavioral Metrics • Click-stream data tracks the exact pattern of a consumer’s navigation through a Web site (or other information space) • Click-stream data can reveal: • Number of pageviews • Pattern of Web sites visited • Length of stay on a Web site • Date and time visited • Number of customers with shopping carts • Number of abandoned shopping carts

  16. Behavioral Metrics • Visitor Web site metrics

  17. Behavioral Metrics • Exposure, visit, and hit Web site metrics

More Related