380 likes | 577 Views
Backup Recovery Systems New Architectures for Improving Performance, Reliability and Driving down Operational Costs. Scott Joseph EMC BRS Manager. Topics of Discussion. Customer Challenges and Market Update EMC Backup Recovery Systems (BRS) Data De-duplication Next Steps.
E N D
Backup Recovery SystemsNew Architectures for Improving Performance, Reliability and Driving down Operational Costs Scott JosephEMC BRS Manager
Topics of Discussion Customer Challenges and Market Update EMC Backup Recovery Systems (BRS) Data De-duplication Next Steps
Optimization Technologies Take Center Stage Server Virtualization Optimization Optimization Optimization Server WANOptimization Network Storage Deduplication
Common Challenges with Backup Environments • Regulatory Issues • Requirements to .keep more .information longer • E-discovery for .litigation • Fines for non-.compliance • Media and Business Issues • Meeting backup windows • Meeting recovery SLAs • Reliability, Performance • Management overhead • Overall cost • Timely restores; Failed restores • Backup jobs running into .production periods • Inability to back up remote .offices • Virtual machines and Virtual Data Centers pose unique backup challenges Information Growth! • Security Issues • Mishandling .customer records • Losing off-site .copies of data 4
When Faced With These Issues…Where Has IT Ended Up? Typical answers: Purchase more cartridges Purchase more tape drives Purchase more tape libraries
Data Protection Market Has Been Dominated by Tape in the past Backup and Replication Software OnsiteProtection Offsite DisasterRecovery / Storage Transportation ApplicationEnvironment PrimaryStorage • 50-year old technology • Large market: $4.7bn 6
Traditional Tradeoff - Tape vs Disk • Expensive • More than we need • Not Portable • Difficult to manage • Not how we do it • Cheap • Easy • Inertia • Well understood • It’s the way we’ve always done it • Good enough • Portable Cost vs SLAs
Tipping Point to Move to Disk • Meets Regulatory and Compliance Requirements • Lower-cost bandwidth • Low-cost hard drives • Improves organizational and opperational efficiencies • Disk libraries offer benefits without process change • “Smarter” backup applications that understand disk • Unreliable • Not secure • Slow • No leverage of information beyond storage Cost vs SLAs
Hitting the Wall… E.G. Quantum + ADIC Tape Revenues Q4-06 – Q3-09 $M Down 58%
It’s an Ongoing Trend… 10 Confidential
Backup Storage Technology “waves” VTLs Tape Automation Integrated Dedupe Systems & Software Backup Systems Market 1990s 2000s 2010s
Backup/Recovery Architectures Evolution Tape Tape Backup Software VTL VTL/Tape Backup Software Backup Software Deduplication storage VM Application Backup Clients Onsite Backup Storage Disaster Recovery Storage Backup/Media Manager Backup/Recovery Architecture Conventional(Tape-centric) Transformational (Dedupe-centric) Deduplication backup software and system on premise off premise
Data Growth While production will grow 5x, backup typically represents a factor of 30x production capacity Daily, weekly, and monthly full backups kept for months or years Server Virtualization VM sprawl creates protection challenges Server consolidation creates high server utilization leaving little bandwidth for backup; conventional backups typically move 200% of the data each week Next Generation Virtual Data Center The introduction of Cloud Computing, with “IT as a Service” models, drives greater availability and resource flexibility Demands lower backup windows and RTO/RPO 2,500 Hardware ESXServer 2,000 1,500 Exabytes 1,000 500 0 2008 2009 2010 2011 2012 Why So Much Interest in Data De-dupe? Major trends influencing the transformation of backup environments Digital Information Created and Replicated Worldwide 5-FOLD Growth in4YEARS Source: IDC Digital Universe white paper, sponsored by EMC, May 2009 Old Paradigm Physical Environment: Low overall server utilization and plenty of bandwidth for backup New Paradigm Virtual Environment: High overall server utilization and littlebandwidth for backup 100% 100% 80% 80% 60% 60% CPU Utilization CPU Utilization 40% 40% Shared Physical Resources 20% 20% 0% 0% Server A Server B Server C Virtual Server A Virtual Server B Virtual Server C 20 percent resource utilization 80 percent resource utilization
Backup/Recovery: Hot Spot in the Enterprise Secular shift from tape-centric to disk/network-centric approaches Enabler: massive data deduplication and compression techniques Unabating growth of enterprise data overwhelms legacy infrastructure Server virtualization another catalyst What are your top storage initiatives?
Data De-duplication is Transformational Market implications: “Gartner views this technology as transformational because it radically decreases the economics of disk-based backup and recovery.” “…too compelling to ignore.” Insights from Gartner “Production deployments of deduplication for backups have progressed at an unusually high rate for such a recent technology.” “By 2012, deduplication will be applied to 75% of all backups.” Recommendations: “…ensure that your organization is comfortable with the robustness and maturity of the vendor's approach.” Source: Dave Russell, Gartner
EMC Backup Recovery Systems (BRS): A Newly Formed EMC Division 1,800 employees 10 R&D locations Data protection storage systems > 50,000 systems installed > 13,000 PB under protection WW Global sales/support/services ~ 40,000 customers $1.5 $1.1 $0.8 $0.6 2006 2007 2008 2009 Total Revenue ($B)
BRS Market Position Avamar #1 de-duplication backup software worldwide > 4,500 installations > 2,500 customers Data Domain #1 deduplication storage worldwide > 9,500 installations > 3,500 customers Disk Library #1 VTL worldwide > $1B Sales NetWorker Top three enterprise backup applications > 30,000 customers
EMC Position in Backup/RecoveryDe-duplication in the F1000 EMC/Data Domain NetApp IBM Symantec FalconStor CommVault Quantum Oracle Microsoft COPAN Asigra Syncsort In Use Now In Pilot/Evaluation HP In Near-term Plan (Through Q2 '09) In Long-term Plan (Q3 '09 – Q1 '10) Dell 0% 10% 20% 30% 40% 50% • Backup re-design is hot • Market penetration still low • EMC has a strong leadership position and best-in-breed technologies TheInfoPro Wave 12 Storage Study, Spring 2009
De-Mystifying Data Deduplication… CommonalityFactoring Fixed Length Device Side Client Side Data De-Duplication Single Instancing Redundant Data Elimination Data Reduction Variable Length Hashing
EMC’s Definition of De-Duplication “The process of detecting and identifying the unique ‘chunks’ within a given set of data, eliminating redundancy when stored or moved.” Uses data identification & comparison algorithms along with content addressing and indexing Unique “chunks” are easily reconstituted to original format from the de-duplicated state Algorithm Data Group 1 Data Group 2 Data Group 3 Before: “chunks” = 39 After: Unique “chunks” = 6
EMC Differentiation – Less is More 100TB lives on 100TB 100TB lives on 50TB 100TB lives on 33TB 5x More Storage, Servers, Bandwidth, Time 100TB lives on 25TB 100TB lives on 5TB Is Fixed Block Really Good Enough? • EMC Data deduplication significantly reduces: • Power, Cooling, Management, Complexity Net: The less storage needed for dedup, the bigger savings on storage. The smaller the storage footprint, the bigger the savings on bandwidth
Factors Impacting De-dupe Ratios for Backup Type of data Data change rate More user created content = higher de-dupe ratio Less change = higher de-dupe ratio Retention policy Full to incremental backup ratio Longer retention policy = higher de-dupe ratio More full backups = higher de-dupe ratio Small variations can have large impact
Real World Results Daily full backups vs. traditional daily full backups Source: EMC While results will vary by data type and mix, Avamar can dramatically improve backup performance and efficiency
Introduce Common De-dupe Values Retain more Retain backups longer, using less disk 10-30x data reduction eliminates the use of tape for operational recovery Replicate smarter Efficiently move data offsite – faster Only move deduplicated data for99% bandwidth efficiency and cost-effective DR Recover reliably Leverage end-to-end dataverification Continuous fault-detection and healing ensure data recoverability to meet SLAs
Differentiate storage system vs. backup software values Retain. Replicate. Recover. De-dupe everything without changing anything Never backup the same data twice Simplify backup, archiving and DR with easy integration across workloads, infrastructures, and backup software Revolutionize your backup by moving less data to solve your toughest VMware, NAS, and remote office backup challenges Data Domain de-duplication Storage Systems Avamar de-duplication Backup Software
Data Domain BasicsEasy integration with existing environment CIFS, NFS, NDMP, OpenStorage Ethernet VTL over FC(not available on DD140) Control Tier Backup & Archive Application Agnostic Target Tier DR Tier Replication DD630 Appliance DD630 Appliance
Industry’s Most Scalable Inline Deduplication Systems Global Deduplication Array DD880 DD600 Appliance Series DDX Array Series Software Options: DD Boost, DD Virtual Tape Library, DD Replicator, DD Retention Lock and DD Encryption Up to 16 Controllers DD140 Remote Office Appliance
Introducing EMC Avamar • Reduces the size of backup data at the source—before it is transferred across the network—reducing backup times by up to 10 times • Reduces required network bandwidth—and the amount of data backed up daily—by up to 500 times • De-duplicates across sites and servers for maximum efficiency • Cost-effectively stores a greater number of full backups on disk—reducing or eliminating the need for tape • Ideal for protecting remote offices, VMware environments, LAN servers in the data center—enabling fast, reliable, and secure backups over existing network connections Revolutionizes Backup with Global, Source Data De-duplication 28
Avamar - How it Works Global Data De-duplication Instances • Client agent scans the data for changes • Modified files broken into sub-file variable length segments • Only unique sub-file segments are backed up Queries local file cache to identify and disregard static files Compresses and applies a hash to each object Queries local hash cache, and then the Avamar server to determine if objects are unique Avamar Data Store or Avamar server
LARGE REMOTE SITE SMALL REMOTE SITE Primary systems Avamar Data Store Avamar agent only on primary systems DATA CENTER Primary systems Avamar Data Store (ENCRYPTED) (ENCRYPTED) (ENCRYPTED) (ENCRYPTED) Avamar Software Agent Avamar Data Store Avamar Flexible Deployment • Complete EMC backup and recovery product • Avamar Data Store • Avamar backup and recovery software with integrated de-duplication • EMC-certified hardware—fully configured and delivered • 4 TB to 32 TB de-duplicated backup capacity • Equivalent of up to 1.1 PB of cumulative traditional disk or tape backup storage* • Backup media requirement reduced 20–40 times • Built-in high availability • Avamar RAIN technology • Spare node, RAID • Redundant power distribution • Daily integrity checks WAN Multi-node configuration • Avamar Data Store Single Node • 1 TB and 2 TB de-duplicated backup capacity • Equivalent of up to 70 TB of cumulative traditional disk or tape backup storage* • Designed for easy deployment at remote offices • Offers fast, local recovery without dependence on a WAN connection REMOTE RECOVERY SITE Primary systems Avamar Data Store * Equivalent traditional backup capacity assumptions: 100 percent Microsoft Office file data, weekly full and daily incremental backups, no compression, 10 percent daily change rate, 90-day retention
Traditional moves ~200% weekly x86 Architecture VMware Virtualization Layer App Application App App App App App App App Application App App App App OS OS Operating System OS OS OS OS OS Operating System OS OS OS OS OS Avamar moves ~2% weekly x86 Architecture VMware Virtualization Layer CPU CPU NIC NIC Disk Disk Memory Memory Optimized Backup for VMware Infrastructure • Up to 95 percent reduction in data moved • Up to 90 percent reduction in backup times • Up to 50 percent reduction in disk impact • Up to 95 percent reduction in NIC usage • Up to 80 percent reduction in CPU usage • Up to 50 percent reduction in memory usage • All backups are stored as “virtual full backups,” ready for immediate restore • Maintains effective consolidation ratios without overtaxing CPU utilization Avamar Efficiently Protects Virtual Machines
Avamar Desktop/Laptop Puts power in end-users hands Eliminates Help Desk for restoring data to desktop or laptop End-users restore their data anytime, anywhere Self-managed restores Document-level search engine All the benefits of Avamar backup Data deduplicated at the source Up to 10 times faster daily full backups Minimal impact on PC and network resources during backup Avamar Desktop/Laptop End-user initiated restore Windows or Mac OS X
Weekly BRS Customer Webcasts- Data Domain, Avamar, NW, DPA Webcast details for Data Domain, DPA, NW and Avamar (2) sessions: • WebEx URL: https://mman.webex.com/mman/j.php?ED=90785562&UID=0 • WebEx password: emcdemo • Dial-in: 888-643-3085, Passcode: press 1, then 28838618# Webcast details for Fri. Avamar (1) session only: • LiveMeeting URL: https://www.mymeetings.com/nc/join/ • LiveMeeting Conference number: RG4548207, Passcode: INTEGRITY • Dial-in: 866-617-1526, Passcode: INTEGRITY
Why EMC and Par4 Data Domain and Avamar Solutions are Designed for Deduplication Minimize media server requirements Minimize storage requirements Fastest time to recover Fastest time to replicate Its easy and it works Data Domain plugs into existing infrastuctures, minimal change required Avamar is a complete solution, with easy to functionality Very high “Net Promoter” scores with customers Proven technology 6th and 7th generation of technology Deduplication products on the market since 2003 Par4 can customize the solution to fit your needs Services and support staff worldwide Broad portfolio
^ BRS