210 likes | 221 Views
Learn how The Boeing Company implemented a data backup solution for 2500 clients, improving reliability, availability, and manageability. Discover the challenges faced, the solution implemented, benefits gained, lessons learned, and plans for the future.
E N D
The Boeing Company2 Years and 2500 Clients Later(Puget Sound) Dick Pain The Boeing Company richard.p.pain@boeing.com
The Boeing Company • Aerospace Industry • Major Sites • Seattle, Washington • Wichita, Kansas • St. Louis, Missouri • Los Angeles, California • Products • Aircraft, including commercial airplanes, helicopters and military aircraft, rockets and space craft. • Customers • Airlines and governments
The Problem • Survey taken in 1996 revealed that: • Many distributed systems did not have backups • Many that did were being stored on site • Restores were difficult • Hard to locate the correct tape • Company Directive (1997) • A project was chartered to come up with a company wide solution • Puget Sound first • Then establish the standard for the rest of the company
The SolutionBackground • The project spent a considerable amount of time in evaluation of products • Over 200 requirements were identified • Each requirement was ranked • In House SMEs (Subject Matter Experts) did evaluations • Each candidate was rated on each requirement • NetBackup was chosen based on a higher rating
The SolutionImplementation • A concerted effort to identify all the servers in Puget Sound was kicked off • Many different programs • Many different methods of operation/support • A team went out to the using community to sell the service • Migration started slowly • Each program did their own testing • Each program set their own schedule • The following architecture was installed and put in production in about a 3 month time frame
The EnvironmentThe Original Installation Sun A3000(1.3TB) Sun E5000 Sun E6000
The EnvironmentThe Original Installation STK 4410 Silo Up to 18 IBM Magstar Tape Drives Sun E6000 Sun A3000 Or A3500 Disk Array
The Environment • Number of clients 2572 • Number of TB 35/week • Number of files 400M/week
Benefits • Performance • Backup are more reliable • Restores are easier to accomplish • Less people time required
Benefits • Availability • Backups run unattended • No one needs to start them • No one needs to load tapes in drives • Automatic restart of failed jobs
Benefits • Manageability • Central Management of Schedules • Central Monitoring of processes • Visibility of Backup Processes • Standardization of processes and procedures
20/20 Hindsight • What we would have done differently • Better data about the environment • More Tape Drives!! • Tips for other users • Watch for processes that start to change • Top 3 things you learned • Always need better data • Involve as many of the affected organizations as possible • Growth will eventually get to the point where it is hard to handle
20/20 Hindsight • Gotchas. • Scheduler problem • Didn’t get the Network Support people as involved as they should have been • Under estimated the amount of daily management required
Plans for the Future • DDBR • Look at Electronic Vaulting • Other projects • Desktop Backup • Cluster
Summary • From an NT SysAdmin: • I can't thank the NetBackup/DDBR group enough. This weekend we ran Blockpoint 5 on our NT Servers. • Two of them went horribly wrong and the operating system (OS) was destroyed. Both systems were not even bootable. • . . . • After installing a separate OS and NetBackup client, we restored the old OS and boot files from NetBackup. • Many customers and especially one admin (me), THANK YOU.
Summary • From His upper management: • Thank you all for providing this security blanket for our customers. DDBR tools, processes and people are providing a consistent valued service to the distributed environment. • From a Briefing following the Worm Virus Incident: • DDBR – Distributed Data Back-up and Recovery; In the past 2 years Boeing invested in the infrastructure (hardware and software) to implement an automated back-up process for the server infrastructure. This automated tape handling system insured a current back up of servers and a process to schedule selective file restores. DDBR supports both NT and UNIX servers.
The Boeing Company2 Years and 2500 Clients Later(Puget Sound) Questions?