440 likes | 451 Views
Explore how Storage Appliance manages data for various applications, offering centralized storage benefits and flexibility, with detailed insights into VERITAS technology and functions.
E N D
Introduction to Storage Appliance • Presentation Overview • The Market Need • Storage Appliance (System Software for Storage Appliance) • Storage Appliance Functions • Based on VERITAS Existing and New Technology • Block Server and File Server Applications • New SAN Protocol • Extending Storage Appliance Architecture
Why Centralized Storage? • IDC’s 1997 survey: How much storage capacity can one IT manager support? • Distributed Servers and Storage = 100 GB • Servers and Storage in 1 room = 200 GB • Consolidated Storage Server = 700 GB • Data Growing at 90% per year (See next slide) • Centralizing storage means labor cost cut to 1/7 the labor cost of Distributed Servers and Storage
• Voice/data integration • Wireless • Video-on-demand WEB Data Analysis EnterpriseApplications Client/Server Basic Accounting Storage Fuels Applications Storage Capacity 70’s 80’s 90’s 00’s 10’s
Customer Examples, Centralized Storage • Silicon Valley Software Company SAP 1998 • Test Deployment 60 GB per server • Final deployment 20 GB per server • Need to re-deploy storage from test environment to final environment • Can we move storage from one facility to another without physical movement of drives? • Can this be done while systems are on-line?
Customer Examples, Centralized Storage • Chicago Ad Agency 1997 • Various imaging / productivity applications • SUN, Intel NT, RS/6000, platforms • Desire to manage storage as a centralized pool as needs change • RS/6000 Shrinks as application platform • NT Grows as application platform • Move applications and storage requirements between operating system platforms as needed
Why Storage Appliance • Virtualized Storage for a SAN • Create Routes / Virtual Disks (target mode) • Assign / Reassign / Change Size on line • Central Point of Management • Richness of VERITAS Software Functions • Server or Back End software • Volume Manager / File System • Replication / Backup / VCS • Client Software • Volume Manager / File System / VCS
Storage Appliance for Blocks or Files Local Area Network Storage Network Disk, RAID, .. One Suite of Software for Storage Management ofSAN (Blocks / Raw Partitions) and NAS (Files) • NAS • CIFS/NFS File Serving /sharing • Remote Mounts / UNIX / NT • SAN • Block Serving across OS Types • Data Required as Blocks (DB, Exchange) • Virtual Disk Manager Flexibility
Storage Appliance Functions • Functions • Multi OS Storage access (NT / Various UNIX) • Centralized Data and Management • Manage Change in Capacity (grow/shrink) • Data (RAID) and Path Protection • Backup / Self Archiving Storage / Replication • Data Access Methods • File Serving through NFS /CIFS • Block Serving through SCSI/FC • New File/Volume Protocols as available
How do VERITAS Hardware Partners Build It? • Use Inexpensive Open System Hardware • “PC” and SPARC OEM system boards • RAID, drives, NIC cards, HBAs etc . • Use Veritas Software • Existing Vol. Manager / File System / Admin. • New Virtual Disk Server (Target Mode) • Existing Options: Backup, Cluster etc. • Use Commodity or Volume OS • Fast, Lightweight on SPARC or Intel PC • Solaris today, Future: Linux, (someday NT?) • RTOS is NOT a requirement nor desired
Network Access (IP) SAN Access (FC) Network Interface Cards Fibre Channel HBAs VIRTUAL DEVICE & Transport SAMBA+ Management interface Java SAMBA Extensions Quick Log Quick I/O VRTS File System VRTS Volume Manager Drivers / Disks /HBAs / RAID Cont . Software Architecture Block Server File Server Add-on STORGAE Applications backup/HSM, etc.. VERITAS Existing VERITAS development OS/Hardware vendor
Existing VERITAS Technology • Volume Manager: • Creates pools of storage / Attributes / RAID • Abstracts physical storage configuration • File system • Allocates virtual disks as files • Easily resizable • Provides “SnapShot” Point in Time Feature • Enables BLIB (Block Level Incremental Backup) Feature • Quick I/O • High speed direct access to files • Initially developed for Database operations • Backup, HSM, Replication, etc.
New Block Serving Technology • Virtual disk layer • Provides Target Mode Access (Storage Appliance looks like disks to client hosts on the SAN) • Manage all capacity from one disk pool • Grow/Shrink capacity per host (or per host assigned volume) as needed • Presents files as targets on the external SAN • Multiple paths: one file can be presented as ANY number of disks to the external SAN • Interface with HBA is defined and available • OS I/O paths are highly optimized • System page cache interface
Reconfigure for 1300 GB Total Storage in Use Before Reconfiguration 1100 GB Total Storage in Use A B C D A B C D FREE POOL 500 200 300 100 500 Reconfiguring Virtual Disks FREE POOL 500 100 400 300 300
New Block Serving Technology • Virtual Disk Management interface • Java based (Microsoft Explorer functionality) • Works in conjunction with the Java based administration for Volume Manager and File System • Long term: Work with VERITAS Storage Management GUI Administration integrating VERITAS products • Provides data-centric administration and configuration • PERL, SQL and JVM APIs
Storage Routing VCS Block Server Personality Application servers FC FABRIC “Front-end” SAN Storage Appliance Storage Appliance High Availability Storage Appliance Farm “Back-end” SAN Physical storage (disk/arrays, tape libraries, etc)
File Server Personality • NFS for UNIX by VxFS with Journal NFS • SAMBA+ supports NT and NT/UNIX Record Locking • Modified SAMBA 2.0.x (back to open source) • integrated with VRTS File System to support coherent oplock model (Optimistic Locks) • performance improvements (eliminate data copying, etc.) • With ACL support, adds NT/UNIX File Locking
New SAN Protocol Needed • Existing storage protocols are not optimal in the SAN environment • Network File System (CIFS/NFS) • Runs on top of a networking stack (File Access) • Doesn’t work well for data/block access • SCSI/Fibre Channel • Doesn’t work well for heterogeneous data sharing • Volume and SAN File protocols needed
LAN / File Sharing protocols (NFS, CIFS/SMB) SAN File Access NAS FileAccess SAN / File Access prot SAN file access LAN file access Device Interface Volume Manager File System SAN / FC protocol OS driver Available Today Application Server Volume Interface Near Future New SAN File System Protocols /APIs SAN / Volume Accessprot Data Flow File system VOL MGR Standard OS Storage Appliance Device
SAN Storage Access Protocol • Merges Block and File access • “Quick I/O for SAN” • Multiple attempts mostly by the hardware storage vendors; • Control of and/or footprint on host is needed • VERITAS is in a unique position to provide BOTH sides of the protocol
Extending Storage Appliance Architecture • Release with Volume Manager, File System, and Virtual Disk Manager • Integrate Backup, HSM , Replication, Clusters • Integrate SAN File System as available • Extend the boundaries of the SAN with: • Global Management • Discovery • Agents in Switches, Routers, etc • The SAN is the Computing and Data Fabric
Zoning & Discovery SAN Fabric Backup & Recovery Cluster & Replication File System Volume & Paths Capacity Allocation SAN Management SAN Services & APIs SRM Applications Distributed SAN Intelligence SAN Fabric VERITAS Long Term Plan A New Infrastructure for Storage Management Applications
Summary BenefitsVERITAS Storage Appliance • Block storage with a Virtual driver to efficiently manage Block related I/O • Resize (Grow or Shrink a volume or file system) • High performance Block Serving with QUICK I/O • File Services I/O with VERITAS File System • Journal for quick recovery • Snapshot Point in Time backup and mount point • NT / UNIX Integration • Common JAVA based GUI administration for Virtual Disk, Volume Manager, File System, etc • Future release Integration with other VERITAS Products • VCS, Backup, Replication, HSM, etc. • Long term Cluster File System for SANs
Veritas SAN Initiative 1998 1999 2000 2001 Beyond Phase 1 SAN Enabled Veritas Products Phase 2 VeritasSAN Editions Phase 3 Veritas SAN Applications • SAN Interoperability • Shared Tape Libraries • Scalable availability clusters • Intelligent Storage “appliances” • SAN Infrastructure Initiatives • SRMs for SANs • Parallel Homogeneous Applications • SAN-Agent aware applications • Expanded platform support • New storage mgmt applications • SAN Suites • IncreasedHeterogeneity
Why VERITAS? • VERITAS is the leading Storage Management technology provider • Current product line (VxFS, VxVM, Clustering, NBU, etc) already implements all the required/desired functionality • HPUX, Solaris, NT, all SVR4 Unix, etc… • Extending the product to Storage Appliance • Storage Appliance View • Combined with Host View, provides total storage management
VERITAS Software Technology • VERITAS Storage Appliance based on Virtual Block Server, VERITAS File System, VERITAS Volume Manager • VERITAS Volume Manager and File System are existing shipping products • Other existing VERITAS products which could be part of the VERITAS Storage Appliance include: • VERITAS Cluster Server • VERITAS Replication Software • VERITAS NetBackup and HSM • VERITAS Software Management • Next slides give a summary look at these existing products
Increase Volume Size Online Veritas Volume Manager • Standard Features • Manage Disks/Volumes • Software RAID • Dynamically Grow / Shrink Volumes • Snapshot Facility • Hot Relocation • Quick Recovery • SAN Features • Dynamic Multi Path DMP • Future Cluster Vol. Mgr. • Remote Mirror / Replication Active Path Active Path Disk Server
Veritas File System • Standard Features • Journal for Quick Recovery • Write to Log, Discovered and Direct I/O • Dynamically Grow / Shrink Capacity On Line • Snapshot Backup, BLIB(Block level Incremental Backup) • Integration with Databases • SAN Enabled Features • BLIB • Replication • Future : CFS
Scalable Server Farm on a SAN (2 to 32 nodes) 1000’s of disks possible Central Storage Pool Reduced HA Cost/host Redundant FC Fabric Common Console Next Release 2H 99 Heterogeneous support(Solaris, HP-UX, NT) Move to 64 nodes VERITAS Cluster Server (VCS) FC connected Hosts FC RAID
SAN-Enabled Backup Fibre Channel SAN Attached RAID Shared Tape Libraries Local Disk • VERITAS BackupExec and NetBackup w/Shared Storage Option • Less disruptive toservers and LAN • Reduced equipmentcosts • Increased automation • GDM Central Mgt.
NetBackup Features • NetBackup provides: • Complete data protection; workgroup to server • Central administration via intuitive GUIs • Mainframe strength media management • Wide Client / Server / Tape Mechanism Support • NDMP Support for NAS and SAN systems • Full disaster recovery support • Non-disruptive backup of enterprise applications • Breakthrough, one of a kind technology • Global Data Manager for Multi Server Environment • HSM Integration, VxVM, VxFS, VCS, Integration • BLIB and extensive database orientation
HSM Features • Integration with NetBackup • Independent Software as well • Standard and Custom Migration Policies • Partial File Caching • Pre Staged Restore (specific time) • Group of Files Restore
Replication Software Features • Supports Remote Backup and Copy on another server • Synchronous means real time mirror, write is complete to both remote and local storage • Asynchronous means time difference between local and remote server • Lower bandwidth link required to remote site • Volume Manager Solaris (Synch/Async) • File System Solaris (Synchronous) • File System NT 4.0 (Asynchronous)
Software Management Features • Volume Manager Optimizer • Volume Manager Task Management • Predictive Failure (Storage Lookout) • Software Resource Management • Backup Management • SAN Block Manager • Future: • SAN Discovery /Zoning (Magellan) • New Central Resource Broker (ISIS)
FS FS The Information-Centric Paradigm RequiresContinuous On-Line Data Availability On-Line DataAccess Data Protection & Recovery Automated Management SANs will revolutionize the data infrastructure for server applications. SAN Application Servers Desktop Applications