170 likes | 270 Views
B513 POWER CUT. 7 TH DECEMBER 2010. 1. B513 electrical infrastructure 2. The power test 3. What is expected from you. BUILDING 513 THE ELECTRICAL INFRASTRUCTURE. THREE MAIN POWER SOURCES Normal power (EBD) Offices, computer center normal power source UPS power (EOD)
E N D
B513 POWER CUT 7TH DECEMBER 2010
1. B513 electrical infrastructure 2. The power test 3. What is expected from you
BUILDING 513 THE ELECTRICAL INFRASTRUCTURE
THREE MAIN POWER SOURCES • Normal power (EBD) • Offices, computer center normal power source • UPS power (EOD) • Take over when normal power is down • Only CC servers • Physics (~10 min) and critical UPS (~15 min) BUT NEVER REALLY TESTED ! • Diesels power (ESD) • Computer centre ventilation units, pumps • Take 2 minutes to start and take over critical UPS ‘indefinitely’ • Cooling units are NOT on UPS nor diesel • hence hot in CC rooms when water tank is empty
Normal Power P C D C C C C V V V V V V V V V V
THREE POWER TESTS 7TH OF DECEMBER
WHY SUCH TESTS • test auto transfer to alternative power sources In case of power failure • UPS backup and then • DIESEL backup OR ELSE west zone power source • without cooling/ventilation temperature rises at 2.75°C/min • when cooling/ventilation are back: temperature drops at 1.22°C/min
Power failure in June 2009 Diesel feeds ESD All cooling capacity approx. 1.22 degrees / min approx. 2.75 degrees / min Power failure on EBD
Test #1 10 seconds on UPS
Test #1 10 seconds on UPS Average CC temperature (Celsius) 29 28 27 26 25 Time (minutes) 1 2 3 4 5 6 7 8 9 10 cold water tank empty EBD + ESD back cooling units fully in prod ventilation units fully in prod
Test #2 Test diesel backup
Test #2 Test diesel backup Average CC temperature (Celsius) 29 28 27 26 25 Time (minutes) 1 2 3 4 5 6 7 8 9 10 ESD cut for 10 sec All ventilation units down again cooling units fully in prod ESD back EBD back cold water tank empty
Test #3 Test west zone coverage
Test #3 Test west zone coverage Average CC temperature (Celsius) 29 28 27 26 25 Time (minutes) 1 2 3 4 5 6 7 8 9 10 cold water tank empty ESD back cooling units fully in prod ESD back ventilation units fully in prod ESD cut for 10 sec All ventilation units down again EBD back
Sysadmin Piquet Be in the operators room Coordinate with the sysadmins in case of problems (too high temperatures) • Second person Use of emergency shutdown script if necessary: step by step in order to preserve hardware and keep critical area alive. • Other team members Be ready but do not go to the operators room unless necessary Take orders from the piquet Open cold aisles doors at power cut (currently recommended by CV) Open CC doors and power on big fans to push cold air from outside BEWARE WIFI will probably be down !!!