930 likes | 1.09k Views
NT Storage Centralization Strategy at Nationwide Building Society. Martin Conway Nationwide Building Society VeriCon.99 4 th November 1999. Agenda. Background on Nationwide Building Society Overview of Exchange Backup Strategy Veritas NetBackup Implementation
E N D
NT Storage Centralization Strategy at Nationwide Building Society Martin ConwayNationwide Building Society VeriCon.99 4th November 1999
Agenda • Background on Nationwide Building Society • Overview of Exchange Backup Strategy • Veritas NetBackup Implementation • Sharing Tape Devices on Fibre Channel Loops • Dynamic Tape Reconfiguration • IP Over Fibre Channel • Automated Disaster Recovery Using Tape • Enterprise Storage Strategies and The Future …
Nationwide Building Society • Financial institution offering investment, lending and insurance services • Two Computer Sites - Production and Development/Disaster Recovery • Two Administration Centres • 850 Retail Branch offices • 1,000 ATM’s • Multiple mainframe, mid-range and server environments
Unisys 2200 IBM OS/390 ICL SX Tandem Himalaya IBM AS/400 UNIX NT
Overview of MS Exchange Environment • Replacing Unisys 2200 based system • Approximately 15,000 users/mail boxes • 10 Digital ZX 7000 NT servers • 1.1 TB of raw disk storage on EMC 5700 • All backup and recovery off-loaded onto EMC storage array and other servers
SCSI MUX E S S S S S S S S S S S S 10 Exchange NT Servers NT Servers ......... IBM ES9000 Mainframe Exchange Data Management Server E Global Cache Mirrored disk EX EX EX EX EX EX TimeFinder - BCV disk EX EX EX EX EX EX
Host View SPLIT Command By Host Data Data BCV Data Copy Within EMC Symmetrix Data Mirror 1 Data Mirror 2 BCV Data Copy Data Mirror 1 Data Mirror 2 Data BCV TimeFinder - Business Continuance Volumes (BCV) Host View
BCV BCV BCV BCV BCV BCV BCV Disk in SPLIT State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV BCV Disk in ESTABLISH State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B Server Issues ESTABLISH Command (Incremental or Full)
BCV BCV BCV BCV BCV BCV BCV Disk in ESTABLISH State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV BCV Disk in ESTABLSIH State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV BCV Disk in ESTABLISH State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV BCV Disk in ESTABLISH State Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV Disk Fully Established Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
x Perform Static Backup -Exchange Service Closed Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
x BCV Disk SPLIT to Create Backup Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B Server Issues SPLIT Command
x Exchange Service Closed Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
x Exchange Service Closed Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
x Exchange Service Closed Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV Exchange Service Closedand Logs Cleared Exchange Database on Striped Disk Exchange Server D/B D/B D/B D/B D/B D/B x
BCV BCV BCV BCV BCV BCV Exchange Service Started - Total Down Time about 4 minutes to do Static Backup of 375 GB Exchange Database on Striped Disk New Logs Exchange Server D/B D/B D/B D/B D/B D/B New Logs Created
BCV BCV BCV BCV BCV BCV Off-line Integrity Check Off-line Integrity Check of Database Backup Exchange Server Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV Tape Backup Mainframe Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV Tape Backup Veritas NetBackup Exchange Database on Striped Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV WAN Replication to Remote Site ? Veritas Replication ESCON SRDF to ATM Remote Site Exchange Server Logs D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV RESTORE Process Backup Exchange Database Logs Exchange Server D/B D/B D/B D/B D/B D/B ? Corrupt Exchange Database
BCV BCV BCV BCV BCV BCV x Close Exchange Service and Issue RESTORE Command Backup Exchange Database Logs Exchange Server D/B D/B D/B D/B D/B D/B Server Issues RESTORE Command (Incremental or Full)
BCV BCV BCV BCV BCV BCV x RESTORE Command in Process Backup Exchange Database Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV x RESTORE Command in Process Backup Exchange Database Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV x RESTORE Command in Process Backup Exchange Database Logs Exchange Server D/B D/B D/B D/B D/B D/B
BCV BCV BCV BCV BCV BCV D/B D/B D/B D/B D/B D/B x RESTORE Command in Process Logs Exchange Server
BCV BCV BCV BCV BCV BCV D/B D/B D/B D/B D/B D/B x RESTORE Command in Process Logs Exchange Server
BCV BCV BCV BCV BCV BCV D/B D/B D/B D/B D/B D/B x RESTORE Command Completed Logs Exchange Server Recovered Exchange Database
BCV BCV BCV BCV BCV BCV D/B D/B D/B D/B D/B D/B Exchange Service Started - Database Logs Rolled ForwardIn Tests 180 GB logically Recovered in under 5 Minutes Logs Exchange Server Recovered Exchange Database
RESTORE Process Complete Fully Synchronised Disk Logs Exchange Server D/B D/B D/B D/B D/B D/B
x Recovery Directly From Tape Veritas NetBackup Logs Exchange Server D/B D/B D/B D/B D/B D/B Database Fully Recovered And Exchange Service Restarted
Logs D/B D/B D/B D/B D/B D/B WAN Logs D/B D/B D/B D/B D/B D/B Data Base - NT Striped Set Ex. 1 BCV BCV BCV BCV BCV BCV 10 Exchange NT Servers Integrity Checking and hot Standby BCV BCV BCV BCV BCV BCV Replic- ation over ATM Ex. 10
Points of note : • All backup and recovery operations automated with PERL scripts • Striped and Volume sets require the use of FTEDIT on NT for NT Backup Server • Use of utilities to Mount and Unmount NT disks and flush cache buffers
Summary • All data management within Storage and tape backup/restore via Veritas NetBackup • Off-line integrity checks via another NT server • No overhead on NT system • Controlled by EMC supplied NT software • Extremely Fast • Simple and easily automated • Downside : volume level - not an issue for Exchange - we are also using it on SQL now
Scope • Currently have Veritas Backup Exec in over 850 branches • Currently putting Fibre Channel based NetBackup solution in Production and Disaster Recovery sites • Planning for 120 to 150 servers in Production and an automated disaster recovery strategy
DLT TAPE Production Robotic Tape Library DLT TAPE DLT TAPE DLT TAPE DLT TAPE Fibre Channel - STK 32 Port Access Hub Direct Backup Direct Attached Media Server Network Backup NT Clients Network Backup Media Server Network Backup Media Server Corporate Network Network Backup Master Server Providing Centralised Management Disaster Recovery Tape Transfer Other Site Disaster Recovery Other Site
DLT TAPE DLT TAPE DLT TAPE DLT TAPE StorageTek Timberwolf 9740 Robotic Tape Library Library Robotic Control SCSI Fast and Wide 20 MB/Sec StorageTek 3100 Bridges SCSI to Fibre Channel Bridge SCSI to Fibre Channel Bridge SCSI to Fibre Channel Bridge SCSI to Fibre Channel Bridge Testing We Have Been Doing in This Environment Fibre Channel 100 MB/Sec Full Duplex CLI 32 Port StorageTek AccessHub 0 1 2 3 9 7 5 4 5 6 8 http Interface: Logical loops Controlled by Server NT Master Server NT Media Server NT Media Server NT Client Veritas NetBackup
Robotic Tape Library DLT TAPE DLT TAPE DLT TAPE DLT TAPE SCSI StorageTek 3100 Bridges 3100 3100 3100 3100 Fibre Channel 32 Port StorageTek AccessHub Veritas SSO
Robotic Tape Library DLT TAPE DLT TAPE DLT TAPE DLT TAPE SCSI StorageTek 3100 Bridges 3100 3100 3100 3100 Fibre Channel 32 Port StorageTek AccessHub Veritas SSO
Issues With This Environment • Fibre Channel Addressing with Emulex LPS HBA - WWN to SCSI Target needs to be manually configured • Fibre Channel LIP causes can tape crash & hang servers • This was a problem with 3100 Bridge that STK diagnosed - awaiting fix shortly • Very Flexible environment - needs further work from tape vendors