360 likes | 577 Views
STORAGE MANAGEMENT. LECTURE 1. Lecture Objectives. Upon completion of this lecture, you will be able to: Describe the importance of information to individuals and to businesses Define data and information Discuss the categories of data
E N D
STORAGE MANAGEMENT Introduction to Information Storage and Management
LECTURE 1 Introduction to Information Storage and Management
Lecture Objectives Upon completion of this lecture, you will be able to: • Describe the importance of information to individuals and to businesses • Define data and information • Discuss the categories of data • Describe the storage architectures and their evolution Introduction to Information Storage and Management
Why Information Storage • “Digital universe – The Information Explosion” • 21st Century is information era • Information is being created at ever increasing rate • Information has become critical for success • We live in an on-command, on-demand world • Example: Social networking sites, e-mails, video and photo sharing website, online shopping, search engines etc • Information management is a big challenge • Organization seek to StoreProtectOptimizeLeverage the information optimally Introduction to Information Storage and Management
Video 01010101010 10101011010 Photo 00010101011 01010101010 10101010101 Book 01010101010 Digital Data Letter What is Data “Collection of raw facts from which conclusions may be drawn” • Most data is being converted into a digital format • Driven by user demand • Facilitated by • Increase in data processing capabilities • New and cheaper peripherals • Lower cost and increased speed of storage • Affordable and faster networks • Who creates data? • Individuals • Businesses Introduction to Information Storage and Management
PDFs E-Mail Attachments X-Rays Unstructured (80%) Check Manuals Instant Messages Images Documents Forms Web Pages Rich Media Contracts Invoices Audio Video Structured (20%) Categories of Data • Data can be categorized as either structured or unstructured data • Structured: • Data Bases • Spread Sheets • Unstructured • Forms • Images • Audio • Movies • Over 80% of enterprise Information is unstructured Introduction to Information Storage and Management Rows and Columns
Define Information • What do individuals/businesses do with the data they collect? • They turn it into “information” • “Information is the intelligence and knowledge derived from data” • Businesses analyze raw data in order to identify meaningful trends • For example: • Buying habits and patterns of customers • Health history of patients • Virtuous cycle of information • Information begets information Introduction to Information Storage and Management
Centralized information storage and processing Network Network Wired Wireless Wireless Wired Accessing Uploading information information Creators of Users of information Information Virtuous cycle of information Demand for more Information Introduction to Information Storage and Management
Value of Information to a Business • Creating a competitive advantage • Identifying new business opportunities • Buying/spending patterns • Internet stores, retail stores, supermarkets • Customer satisfaction/service • Tracking shipments, and deliveries • Identifying patterns that lead to changes in existing business • Reduced cost • Just-in-time inventory, eliminating over-stocking of products, optimizing shipment and delivery • New services • Security alerts for “stolen” credit card purchases • Targeted marketing campaigns • Communicate to bank customers with high account balances about a special savings plan Introduction to Information Storage and Management
Storage • Data created by individuals/businesses must be stored for further processing • Type of storage used is based on the type of data and the rate at which it is created and used • Examples: • Individuals: Digital camera, Cell phone, DVD’s, Hard disk • Businesses: Hard disk, external disk arrays, tape library • Storage model: An evolution • Centralized: mainframe computers • Decentralized: Client – server model (Data spread across many servers) • Centralized: Storage Networking (Hugh respositories) Introduction to Information Storage and Management
Multi Protocol Router FC SAN LAN IP SAN SAN / NAS RAID Array JBOD Internal DAS Time Storage Technology and Architecture Evolution Introduction to Information Storage and Management
Lesson Summary Key points covered in this lesson: • Importance of information • Data, information and storage • Categories of data • Storage architectures and their evolution Introduction to Information Storage and Management
Lecture 2 • Challenges in Data Storage and Management Introduction to Information Storage and Management
Upon completion of this lecture, you will be able to: • List the five core elements of a data center infrastructure • Describe the requirements of storage systems for optimally supporting business activities • Explain the importance of Information Lifecycle Management • List the activities in developing the ILM strategy Introduction to Information Storage and Management
The Core Elements • Applications • Databases – Database Management System (DBMS) and the physical and logical storage of data • Servers/Operating systems • Networks (LAN and SAN) • Storage arrays Data Center Infrastructure
Example of a Data Center Infrastructure Storage Array Server Client Storage Area Network Local Area Network Application User Interface OS and DBMS Database Consider an order processing system consisting of: • Application for order entry • Database Management System (DBMS) to store customer and product information • Server/Operating System (OS) on which the application and database programs are run • Networks that provide • Connectivity between Clients and the Application/Database Server (LAN) • Connectivity between the Server and the Storage system (SAN) • Storage Array – database is stored on physical disks in the storage array Data Center Infrastructure
An Example - Closer Look Storage Array Server • A customer order is entered via the Application User Interface on a client Client Storage Area Network Local Area Network Application User Interface OS and DBMS Database Data Center Infrastructure
An Example - Closer Look (continued) Storage Array Server • A customer order is entered via the Application User Interface on a client • The client accesses the server over a Local Area Network Client Storage Area Network Local Area Network OS and DBMS Database Data Center Infrastructure
An Example - Closer Look (continued) Storage Array Server • A DBMS uses the operating system on the server to read and write this data to the physical location on a disk Client Storage Area Network Local Area Network O/S and DBMS Database Data Center Infrastructure
An Example - Closer Look (continued) Storage Array Server • A DBMS uses the operating system on the server to read and write this data to the physical location on disk • A dedicated Storage Area Network provides the communication link between the server and the storage array, and transports the read/write commands and data between the server and the storage array Client Storage Area Network Local Area Network O/S and DBMS Database Data Center Infrastructure
An Example - Closer Look (continued) Storage Array Server • A DBMS uses the operating system on the server to read and write this data to the physical location on disk • A Network provides the communication link between the client and the server, and transports the read/write commands and data between the server and the storage array • A storage array receives the read/write commands and data from the server and performs the necessary operations to store the data on the physical disks Client Storage Area Network Local Area Network Database Data Center Infrastructure
Optimal Order Processing Example • The application should be optimized for fast interaction with the DBMS • The tables in the database should be constructed with care so the number of read/write operations can be minimized • The server should have sufficient CPU and memory resources to satisfy application and DBMS needs • The different networks should provide fast communication between client and server, as well as server and storage array • The storage array should service the read/write requests from the server for optimal performance Data Center Infrastructure
Final Look at Data Access - Example When the DBMS receives a request from the application: • It first searches the server memory; if data is found there, the operation takes about a millisecond • If not, it uses the operating system to request the data from the storage array • Dedicated high speed networks transport this request to the storage array • Intelligent storage arrays can deliver the requested data within a few milliseconds, and are typically configured to protect data in the event of drive failures Data Center Infrastructure
Availability Security Data Integrity Manageability Capacity Performance Scalability Key Requirements for Data Center Elements Introduction to Information Storage and Management
Challenges in Managing Information • Exploding digital universe • Multifold increase of information growth • Increasing dependency on information • The strategic use of information plays • Changing value of information • Information that is valuable today may become less important tomorrow. Introduction to Information Storage and Management
Some Constraints to Meeting the Requirements Constraints include: • Cost • Physical environment • Maintenance and support • Compliance – regulatory and legal • Hardware and software infrastructure • Interoperability and compatibility Data Center Infrastructure
Management Activities Data Center management activities include: • Provisioning/Capacity/Resource Planning • Monitoring • Reporting Data Center Infrastructure
Lecture 3 • Data Storage Infrastructure • Information Lifecycle Introduction to Information Storage and Management
Protect New Process Deliver Warranty order order order claim Time Value Fulfilled Aged Warranty order data Voided Migrate Create Access Archive Dispose Information Lifecycle Management A proactive strategy that enables an IT organization to effectively manage the data throughout its lifecycle Introduction to Information Storage and Management
AUTOMATED Implement policies with information management tools Classifydata /applications based on business rules Integrated management ofstorage environment Organizestorage resources toalign with data classes FLEXIBLE Information Lifecycle Management Process Policy-based Alignment of Storage Infrastructure with Data Value Introduction to Information Storage and Management
Benefits of Implementing ILM • Improved utilization • Tiered storage platforms • Simplified management • Processes, tools and automation • Simplified backup and recovery • A wider range of options to balance the need for business continuity • Maintaining compliance • Knowledge of what data needs to be protected for what length of time • Lower Total Cost of Ownership • By aligning the infrastructure and management costs with information value Introduction to Information Storage and Management
Lesson Summary Key points covered in this lesson: • The five core elements of a Data Center infrastructure • Key requirements of storage systems to support business activities, as well as some of the constraints • ILM strategy • Importance • Characteristics • Activities in developing ILM strategy • IML implementation • Benefits of ILM Introduction to Information Storage and Management
Chapter Summary Key points covered in this Chapter: • Importance of data, information, and storage infrastructure • Types of data, its value, and key management requirements of a storage system • Evolution of storage architectures • Core elements of a data center • Importance of the ILM strategy Introduction to Information Storage and Management