440 likes | 686 Views
GIG Tech Summit – Session 143 Backup Solutions – NetWorker/AlphaStor. Karl Mowell, IST April 2, 2007. Session 143 Agenda. NetWorker Customer challenges Terminology What is it? NMC – NetWorker Management Console Troubleshooting Roadmap AlphaStor What is it? History Terminology
E N D
GIG Tech Summit – Session 143Backup Solutions – NetWorker/AlphaStor Karl Mowell, IST April 2, 2007
Session 143 Agenda • NetWorker • Customer challenges • Terminology • What is it? • NMC – NetWorker Management Console • Troubleshooting • Roadmap • AlphaStor • What is it? History • Terminology • Troubleshooting • Roadmap
EMC NetWorker Security, Simplicity, and Speed for Backup and Recovery
NetWorker Terminology • NetWorker Server – Server that maintains the databases and client file Indexes. Controls the initiation of the backup jobs • NetWorker Storage Node – Server that allows access to tape devices and used by clients to backup their data across the network. • NetWorker Client – Servers that contains the data to be backed up. • Niser (nsr) – most of the cli commands start with “nsr”, also the directory that NetWorker is installed under is “nsr”. The term “niser” is used to describe this. • Pools – This is used to identify the tapes and how they will be used • Groups – used to group like data together • Clients – identifies the data for each Client server that is to be backed up. • Datazone – Collection of a NetWorker Server, storage nodes and clients
Architecture of NetWorker • NetWorker is a 3-tier product. • Server • The server is the portion that maintains the NetWorker databases, Client file indexes, etc. • Performs the selection process of the devices to be used. • Passes the process to the necessary storage node client • Controls libraries and devices (tape, disk) • Storage Node • Two types – Dedicated, Standard • Dedicated - can only backup its one data • Standard – used to backup multiple clients • Controls libraries and devices (Tape, Disk) • Client • Sends the data to it’s associated storage node or to the Server
Service Level Objectives EMC NetWorker Backup and Recovery Software • Map protection levels to RTO and RPO • Simplify management and administration • Monitor and analyze for fast problem resolution and system optimization NetWorker Advanced backup Snapshot and Replication Management Backup to disk DiskBackup Option and VTL Basic Tape backup and recovery
WAN NetWorker Backup and Recovery • Holistic enterprise protection • Critical applications, platforms, topologies and storage • Scalable architecture • 256-bit AES encryption and secure authentication • Centralized management • Graphical user interface • Customizable reporting • Wizard-driven configuration • Performance • Storage nodes • Data multiplexing and advanced indexing • Tape and disk backup, staging, cloning • Efficient media management • Snapshot management Solution Features Remote Storage Node/Clients Linux,Unix, Windows, Mac clients Key applications LAN Backup server NAS (NDMP) Storage Node SAN Tape/Disk
Application Application Application Critical Application and Database Protection Backup without Application Modules Backup with NetWorker Application Modules Offline (Cold) Œ Shut down application 24x7 OPERATIONS DOWNTIME Back up application SAVE NetWorker MODULE Ž Restart application Integration with application APIs for backup and recovery
Heterogeneous Support Advantage Applications Operating Systems Sun IBM IBM HP IBM Informix Novell
NMC – NetWorker Management Console • Intuitive operations and navigation • Redesigned NetWorker Management Console • Web-enabled management • Single point for administration, monitoring, and reporting • Manage multiple NetWorker servers • Centralize device setup and management • Easy launch of NetWorker recover applications and wizards • Role-based access security with unique user login/password • Activity-auditing reports 10
Terminology • Control Zone • Console server and its managed nodes • Data Zone • A NW server, its clients and storage nodes • Console Server • Host where Console is installed • Platforms: Windows & Solaris • Console Client • Downloaded Java app via IE or Netscape • Managed Node • NW server managed by Console • Platforms: Windows, Linux, UNIX
Current Product Features • Centralized Enterprise Hierarchy • Logical map of NetWorker servers • Centralized Managed Events • View & sort NetWorker error messages - by priority, server, … • Annotations & Notes can be added to events • Centralized Reporting • Consolidated status for all NetWorker savegrps • Centralized Administration • Provides cross-platform consistency
Elements of Console Windows • Task Bar • Separate tasks user performs. Drives how the rest of screen drawn. • Menu Bar • Changes depending upon task. A “task specific” menu item will appear. This menu item can be accessed via a right-mouse click. • Tool Bar • Task specific. Some actions will behave differently depending upon the object selected in the navigation or details pane. • Navigation Pane • Classic “tree view” organization. Not all task areas have a navigation pane. • Details Pane • Where details, results or messages are displayed. Generally, the details pane consists of a table.
Groups Arch Reqs Devices Alerts Sessions Log Server, group & client resources Library and Device Config/Ops Navigation between Console and Admin ConsoleWindow NW AdminWindow Label TapesPoolsVolumesIndexesSaveset Query
Standard Console features (cont) • “Default” table columns are the ones predefined by Console (however, there is, currently, no way to “reset” back to the default set of columns) • All table columns can be sorted, reordered and resized • User preferences are saved in the Console database (therefore, they “follow” the user, not the machine) • Preferences are different for Console and Admin sessions • Online Help is screen “context” sensitive (new for Keystone) • All help content is single-sourced, i.e. printed docs and online help are the same (new for Keystone)
Troubleshooting: NMC Server • Review log files on Windows: C:\Program Files\Legato\Management\GST\logs on Solaris: /opt/LGTObgst/logs • Start gstd with -Dn, where n = 1 through 6 (a lot of output above 2) • Debug level can be changed from the System Options (Setup task) • Environment variables • GST_MAXLOGSIZE • GST_MAXLOGVERS • GST_DEBUG
Troubleshooting: Server Directories The logs directory The DB directory
Troubleshooting: NMC Client Enable the output of client log messages: • Open the Java Web Start Application Manager • Go to File->Preferences->Advanced • Check "Show Java Console" to display Java Console window when the client is running. • Check "Log Output" if you would like the info in a file.
Troubleshooting: Client Debug Level Set the debug level of the client by: • Pressing CTRL, SHIFT & right mouse button in any details pane (right side of screen) • In the menu, select required debug level • Output to Java Console (see previous slide)
Ease-of-Use • Backup configuration wizards • Devices • File systems • Applications • Easy-to-use client interface • User-managed backup andrecovery • Intuitive operations • Flexible search capability
NetWorker Dashboard: Advanced Analytics • Add-on NetWorker option for intelligent backup-correlation and impact-analysis • Reporting, monitoring, and alerting integrated directly into the NetWorker Management Console • Gathers information from NetWorker Servers, Storage Nodes, and clients • Collects host operating system resource statistics for CPU, disk, and memory usage • Broadcasts status of savegroups, clients, devices, and media • Alerts when something may impact the success of NetWorker savegroups
Open Tape Format Datastream multiplexing Self-contained indexing Cross-platform format UNIX Windows Linux Minimize impact of tape corruption – skip bad media records Native Library Sharing Dynamic drive sharing Cross-platform tape-drive sharing On-demand device usage Reduce hardware total cost of ownership Tape-Management Advantages NetWorker UNIX/Linux NetWorker Windows
NetWorker Documentation Reference resources for NetWorker include: • EMC NetWorker Release Notes (UNIX/Linux, Windows) • EMC NetWorker Installation Guide (Platform-specific) • EMC NetWorker Multiplatform Version Administration Guide • EMC NetWorker Module Guides
NetWorker NDMP Backup and Recovery • Network Data Management Protocol (NDMP) • Simplifies and speeds the protection of Network Attached Storage (NAS) • Enables full catalog of local and remote backup • NetWorker offers unique capabilities with NDMP • Direct Access Restore (DAR) • Dynamic Drive Sharing (DDS) with NDMP and non-NDMP backups • NDMP cloning • Data Service Agent (DSA) enables NDMP backup to disk NAS NAS NAS LAN Backup server Storage Node SAN NAS Tape/Disk
Tape Doesn’t Always Meet the Challenges • Performance limitations • Limited throughput • No random access • Availability limitations • RAID not available with tape • “Expired” tapes after several uses • Management complexities • Complex restore • Cost are high • Large effort required to manage thousands of tapes 25
Benefits of Disk-focused Backup and Recovery Solutions • Performance • Up to 5x performance increase for restore • Up to 3x performance increase for backup • Availability • Reliable backup-and-restore operations • Management efficiency • Save hours of staff time • Improve productivity • Data retention • Data on disk can be remotely copied; no reliance on shipping • Data easily retrieved Better performing, predictable backup and recovery 26
NetWorker DiskBackup Option • Fast and reliable backup and recovery • Eliminate mount, start and stop, rewind and fast-forward • Leverage concurrent operations to enhance backup/recovery • Backup, recover clone and stage – simultaneously • Recover with multiple concurrent streams • Policy-based Staging and Cloning • Automated migration of data from disk to tape for secondary protection • Up to 50% faster • Clone backups jobs as they complete • Reduce wear and tear on tape drives and cartridges
VTL + Storage Node EMC Disk Library Virtual Tape Library Integration • Backup-to-disk in a simple solution • Plug-and-play – appears as tape library • Requires no change to operational processes • Reliable and scalable • EMC Disk Library with NetWorker Storage Node • EMC specific VTL solution with embedded backup application • Faster time to recovery • Reduces network traffic • Consolidated Media Management with single point of control for virtual and physical tape pools • Easy remote backup, recovery and cloning between Disk Libraries
Snapshot 6:00 p.m. Snapshot 1:00 p.m. Snapshot 8:00 a.m. Integrated Snapshot Management to Meet RTO/RPO • PowerSnap and VSS add-on modules leverage snapshot technologies for data protection and recovery • Application-aware protection • Support for EMC CLARiiON, Symmetrix, Celerra, and third-party solutions • Instant backup and recovery with point-in-time snapshots/mirrors • Off-host live backup to disk/tape • Policy-based management Application Server Production volume Tape/DR Recovery Operational Recovery Proxy Server
NetWorker Snapshot Management Policies • Number of Snapshots • How many to take per day • Retain Snapshots • How many to retain at any time • Snapshot Expiration Policy • When to expire copies • Backup Snapshots • Which copies to backup to tape
IP SnapImage Module - Block-level Data Movement • Uses host-based snapshot to capture and move block-level disk image • Generates index for file-level recovery—or entire volume • Enables serverless backup and recovery • Not tied to a specific array • Delivers significantly faster backup (to tape, virtual tape, disk) and recovery Backup server Client Client Prod volume Index Snap shot Snap shot Any Disk San Switch Prod volume Up to 10x faster! Prod volume Prod volume Any Disk Tape/Disk Library EMC Symmetrix EMC CLARiiON
Troubleshooting • NetWorker produces several logs. • Daemon logs • Messages file • Location: - <installed directory>/nsr/logs • Setting debugging
Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 2006 2007 2007 2007 2007 2008 2008 2008 Roadmap Overview: NetWorker Core • NetWorker VSS Client v1.1 • Vista, Longhorn VSS Support • SharePoint 2007 • SQL Server 2007 • Exchange 2007 • NetWorker v7.4 • Internationalization • Multi-Locale Environment Support • Inactive file reports • NMC Usability Enhancements • Drag/Drop, Copy/Paste • Solaris 10 Zones / Containers support • NetWorker v7.x • Security • IPv6 support • Embedded VSS + additional writers NetWorker Backup Dashboard • NetWorker v7.4.x • Data de-duplication (phase 2) with Localization (L10N) NetWorker v7.3.2 for OpenVMS • NetWorker v7.3.3 • De-duplicating storage node • Configuration & management of de- duplicating clients • Windows Vista Released Content Committed Content Non-committed Content
Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 2006 2007 2007 2007 2007 2008 2008 2008 Roadmap Overview: NetWorker Modules • Modules – Security, IPv6 • NME 5.1 – Exchange • NMO 4.6 – Oracle • NMDB2 3.0 – DB2 • NMSAP 4.0 – SAP • NW SharePoint 2.0 (NW integration) • NML 3.0 – Lotus Notes • NMSQL 5.1 – SQL Server • NMVSS for W2K3 – MS VSS • NW Meditech • NW Informix • NW Sybase • Modules – Internationalization • NMO 4.5 – Oracle* • RMAN Recovery Script Wizard • Disk staging • Encryption • NMSQL 5.1- SQL* • NME 5.1 – Exchange* • NMSAP 3.5 – SAP* • NMI 3.0 – Informix • NMS 3.0 Sybase • VSS for Client for Win2K3 • Point in time copies for restore • Transaction consistency • SAN Storage Node Support • Module for Meditech v1.1 • Symmetrix support • Client/server (CS) platform • Module for Documentum v2.1 • Documentum D6 support • Internationalization • Configuration Wizards • Module for Exchange 5.0 • Exchange 2007 support EMC Backup Manager for SharePoint v1.0 • EMC Backup Manager for SharePoint v2.0 • SharePoint 2007 Module for Meditech v1.0 * Localization Released Content • Module for Documentum v1.2 • Support for distributed environments Committed Content Non-committed Content
Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 2006 2007 2007 2007 2007 2008 2008 2008 Roadmap Overview: NetWorker PowerSnap Modules • PowerSnap x.x • IPV6 • RecoverPoint enhancements • Security enhancements • Backup encryption • Installability/configuration enhancements • PowerSnap for EMC Celerra • EMC SnapSure support • PowerSnap for Symmetrix • AIX support • PowerSnap v2.4 • I18N • RecoverPoint on Windows • X64 Windows on Symmetrix, CLARiiON, and Celerra • CLARiiON Clones • Symmetrix SRDF Released Content Committed Content Non-committed Content
Backup server 1 Backup server 2 Backup server 3 Tape library EMC AlphaStor server Advanced Media Management - AlphaStor • Device and library sharing • Consolidate resources • Reduce tape-library total cost of ownership • Controls resource allocation • Has the capability for queuing requests • Media lifecycle management • Track movement of tapes • Increase tape return on investment • Improve management Tapes to move offsite Tapes to return for reuse
AlphaStor Terminology • AlphaStor Server – Media manager, contains database of media information, controls assigning and appyling of rotation policies • LCP – Library Control. Controls the arm of the library, talks to the library to obtain inventories of tapes and controls physical movement of tape from slot to drives. Also controls the importing and exporting of tapes. • DCP – Device Control. This is a very simplistic daemon. It has 2 functions, ejection of tapes from the tape drive and execution of NetWorker CLI when requested by the Server. • Rotation Policy: This is the Policy(s) that control the movement of tapes from onsite to offsite storage and back.
Multiple OS Platforms Supported AlphaStor Server runs on AlphaStor Server AlphaStor LCP/DCP Sun Sun IBM HP True64
History of AlphaStor • Developed by company called SCH Technologies • Private company owned by investor group • Ran by Ed Bauer • Original name was Software Clearing House • Acquired by Legato in 2001 • Came from a need in the market place for a heterogeneous Mainframe class tape management system. • Only product that had that ability was REELLibararian, which was EOL’d. Owned by STK who decided get out of the Backup/Recovery Software market. • Originally developed to be able to do tape management for a multitude of “data movers”. NetWorker, Veritas, TSM, etc. • NetWorker was “first” datamover selected due to ease of interface protocol.
Installation • AlphaStor Server • Install Shield for Windows; pkgadd for Solaris • Can install in any available disk • Default: Windows – C:/AS; Unix - /AS • Not recommended to install on same server as the NetWorker Server • LCP • Windows: Install shield; Solaris – pkgadd; Other: install script • Requires control path to the Library • Can be any server in the network. • DCP • Windows: Install shield; Solaris – pkgadd; Other: install script • Install on all servers that are NetWorker Servers and Storage nodes with tape drive access
AlphaStor allows for multiple NetWorker Datazones to utilize the use of the Tape libraries and drives. AlphaStor Device Management Datazone 1 Datazone 2 AlphaStor Server AlphaStor Server
AlphaStor Libraries • Works with most of the same libraries that NetWorker works with. • IBM, StorageTek, HP, ATL, Qualstar, ADIC, etc. • Works with IP controlled libraries (IBM 3494), and ACSLS controlled libraries • Supports most of the tape devices that NetWorker will support. • LTO • DLT • AIT • 8mm • 3592
Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 2006 2007 2007 2007 2007 2008 2008 2008 Roadmap Overview: AlphaStor • AlphaStor x.x • Data Mover Interface 2.0 • IEEE 1244 media management • Avamar support • DiskXtender support • NetWorker 7.4 support Released Content Committed Content Non-committed Content