390 likes | 575 Views
Session1: SAP HANA and Big Data. Dr. Bjarne Berg Associate professor Computer Science Lenoir-Rhyne University. Introduction. The introductory session will look at the topic of big data and new computer capabilities with much faster in-memory data processing.
E N D
Session1: SAP HANA and Big Data Dr. Bjarne Berg Associate professor Computer Science Lenoir-Rhyne University
Introduction The introductory session will look at the topic of big data and new computer capabilities with much faster in-memory data processing. We will look at how the explosion in data growth is changing the way in which data is collected, analyzed, transmitted, and stored. We will also explore how SAP HANA is transforming system landscapes, data warehousing, ERP processing, and real-time data access. The session ends with a live demo of SAP HANA and BusinessObjects dashboards and reporting.
Session Agenda • Introduction • Why Change to In-Memory Processing? • The Early Solutions • SAP HANA an Introduction • Demo • New Innovation and Interesting Usages • The Future and Big-DataTrends • Questions and Answers
The Creation of Big Data • 90% of all digital information was created in the last 3 years. • By 2020 we will have 5,600 GB of data for every person on earth (incl. pictures, movies and music). • That is 40 Zettabytes! The Issue: How do we store the big data and how can we access it faster?
Where is the data Located and What Drives the Growth? Source: WipPro, 2013
Data is Created Everywhere • Total number of hours spend on facebook each month: 700 Billion • Data sent and received by mobile platforms and phones: 1.3 Exabytes • Number of emails sent each day: 2.5 Billion • Data processed by Google each day: 2.4 Petabytes • Videos uploaded to YouTube each day: 1.7 million hours • Data consumed by each world’s household each day: 357 MB (growing fast)! • Number of tweets send each day: 50 Million • Number of Products sold on Amazon each hour: 263 Thousand Every day we create 25,000,000,000,000,000,000 bytes of data! (that is 25 quintillion bytes).
Who Benefits the Most of Big-Data Access? Source: University of Texas
Why In-Memory Processing? Focus Technology 1990 2013 Improvement 0.05 MIPS/$ 304.17 MIPS/$ 6083x CPU 0.02 MB/$ 52.27 MB/$ 2614x Memory 216 264 248x Addressable Memory 100 Mbps 100 Gbps 1000 x Network Speed 5 MBPS 620 MBPS 124x Disk Data Transfer Source: 1990 numbers SAP AG, 2013 numbers, Dr. Berg Source: BI Survey of 534 BI professionals, InformationWeek, Disk speed is growing slower than all other hardware components, while the need for speed is increasing.
Why Change to In-Memory Processing? • An History Lesson: • File systems were created to manage hard disks • Relational Databases were made to manage file stems • Application Servers were created to speed up applications that ran on a database. • Therefore: • Hard drives are DYING! • Relational databases are DEAD (they just don’t know it!) • Application Servers will become less important
Session Agenda • Introduction • Why Change to In-Memory Processing? • The Early Solutions • SAP HANA an Introduction • Demo • New Innovation and Interesting Usages • The Future and Big-DataTrends • Questions and Answers
The Rate of Change – Disruptive Technologies • Moore’s Law in technology: • Processing Speed will double every 18 month • Paradigm shifts: • SAP HANA queries are executed 400-900 times faster than on relational databases The rate of change in Paradigm Shifts is much faster than the incremental changes and a much lower cost
Session Agenda • Introduction • Why Change to In-Memory Processing? • The Early Solutions • SAP HANA an Introduction • Demo • New Innovation and Interesting Usages • The Future and Big-DataTrends • Questions and Answers
SAP HANA — In Memory Options • SAP HANA is sold as an in-memory appliance. This means that both Software and Hardware are included from the vendors • Currently you can buy SAP HANA solutions from Cisco, Dell, Fujitsu, IBM, NEC, Hitachi and HP • The future of SAP HANA is to replace relational databases of ERP and data warehouses and run these on the in-memory platform Source SAP AG, SAP HANA has radically changed the way databases operate and make systems dramatically faster.
SAP HANA — In Memory Options There are currently 7 different certified HANA hardware vendors with 13 different products. Some boxes can be used as single nodes with others are intended for scale-out solutions for large multi-node systems
SAP HANA — Available Special Applications • New Applications has been built that run on SAP HANA in-memory processing and you can also build your own Applications developed by SAP Planning & consolidation Customer revenue performance mgmt Predictive segmentation & targeting Trade promotion management Merchandise & assortment planning Sales & operations planning (SOP) Demand signal repository Profitability analysis Dynamic cash management Strategic workforce planning Smart meter analytics (power companies) and much more… ERP HANA BI Solutions Virtual Data Marts Virtual Data Marts Database Applications Virtual Data Marts Virtual Data Marts Databases Files This provides much tighter integration with the source system (less data latency) and much faster query response time for high-volume analysis
SAP BusinessObjects Dashboards for Enterprise Management Dashboards can be built using the SAP BusinessObjects Dashboards tool that takes advantage of the sub-second speed of HANA.
SAP Dashboards Example — Flexibility • Graphs can be displayed many ways • Navigation can be done and saved as “scenarios
SAP Dashboards — Mobile Example • Dashboards are most useful when compared to something • This dashboard is relative to a business plan • Notice that all graphs can be displayed many ways and that color coding is consistent across dashboards It is all about getting fast performance when accessing high volumes of data
Formatted Number based Dashboard Example Dashboards can also be highly formatted and static with little user interaction The In-Memory capabilities of HANA allows managers to see all financials in one-place in hyper-fast speed..
Operational Dashboards for Line Managers • Dashboards can be operational • This dashboard focus on billing disputes and is used to monitor closing of cases • The users of this dashboard are clerks in the billing office, not executives With HANA – Real-time operational dashboards can by pushed to managers everywhere
Link of HANA data to Maps and News Feeds • Dashboards are most useful when shared with others • Power users can create great departmental dashboards that can be shared inside smaller organizational units In this dashboard, the data is merged with Google maps and external news feeds. This makes the dashboard much more interactive and interesting.
Session Agenda • Introduction • Why Change to In-Memory Processing? • The Early Solutions • SAP HANA an Introduction • Demo • New Innovation and Interesting Usages • The Future and Big-DataTrends • Questions and Answers
BI Workspaces and Modules BI Workspaces allows you to link many SAP BI tools in the same area, without the need to jump between them. In this workspace, we have 6 Objects with 4 different technologies.
New Innovation in Medical Field for Big Data CAT Scan of Tumor Patient • CAT scans and X-Rays create an large amount of data that doctors have to review and access X-Ray of Cancer Patient • HANA can store this and provide high volume and provide almost instant access to hundreds of Terabytes of data
New Big-Data Innovation in Safety and Security • Thousands of hours of video is taken at airports, banks, casinos, borders and other sensitive areas • Facial recognition software can identify wanted criminals • SAP HANA can store that data and process the information
New Big-Data Innovation – Weather and Fishery tracking • Tracking whether and execute predictive models require significant number of data points with high data volume • Modeling resources such as fisheries and specie movements also require significant data volumes and data points on catch information across the globe
New Big-Data Innovation – Company War Rooms • In a multi-national company, data is created and consumed everywhere. • With SAP HANA you can create a corporate war-room to track customer demand, shipments, marketing success and business intelligence This picture is from Sprint phone company’s war-room to track usage and transition issues during system mergers and product launches.
New Big-Data Innovation – Pollution Tracking • Geo data from pollution, data modeling and tracking creates hundreds of Terabytes. • SAP HANA can assist in storing and retrieving this data With Predictive modeling and data visualization you can build sophisticated models on HANA. You can even use the R-statistical library
New Big-Data innovation – Scientific Discovery • The super collider center CERN, creates over one PetaByte every second it operates. • The new Spectre R telescope of Russia has 1000 times higher resolution than Hubble, generating billions of bytes of data.
Session Agenda • Introduction • Why Change to In-Memory Processing? • The Early Solutions • SAP HANA an Introduction • Demo • New Innovation and Interesting Usages • The Future and Big-DataTrends • Questions and Answers
The Future and Big-Data Trends • Internet usage Map by protocol • Big data is being generated from micro and macro levels. • From human DNA for each person to the content of billions of stars in galaxies. • A Map on the Whole Internet • Computer based human interaction is getting more common and generating terabytes of data each second Big-Data is only get more prominent. – can computers keep up?
The Future and Big-Data Trends – More Imaging • A data explosion visualized – Micro loans made • Companies will start accessing data visually instead of by numbers and text. Users will have on-demand access to all movies, songs, information in sub-second speed
Summary • SAP is a highly innovative company • We are removing hard drives and relational databases • Processing is going to in-memory • SAP HANA can do all this today • First we will move all data warehouses to HANA, then all ERP systems • HAHA is much more than ECC and SAP BW (current tools) • HANA is a paradigm shift with lower operating costs • HANA is available today and is being implemented at hundreds of companies in regular industries right now.
Questions and Answers Dr. Berg Bergb@lr.edu