Forecasting Data Center Power Requirements: Tips from the Trenches

1. Forecasting Data Center Power Requirements:Tips from the Trenches Frank Bereznay Kaiser Permanente

2. Agenda • Overall Facility Utilization / Usage Profiles • Measuring Power Usage at the Equipment Level • Reporting and Forecasting Techniques • Summary

3. Facility Overview • Two Story Facility • Built in the early 1990’s to accommodate mainframe class equipment. • 2 UPS Systems • Primary UPS (A/B) 2,400 KW • Secondary UPS (C/D) 600 KW  Added later • 3,500 Items Connected to UPS Systems • Equipment Mix Described as typical for today’s Data Center. • Newer blade farms creating hot spots for A/C systems

4. Initial Measurements • There were a lot of opinions about the overall utilization profile for the UPS systems, but nobody had hard empirical data. • A low tech ‘clip board’ agent was installed and activated at the UPS panels at four hour intervals.

5. Initial Measurements

6. Initial Measurements

7. Usage Profile by Equipment Type

8. Measuring Power Usage at the Equipment Level • Not as easy as it sounds. • Engineers were reluctant to open up the back side of PDU cabinets to attach reading devices. • Power cables coming out of the cabinet were not labeled. • Similar situation at equipment end of power run.

9. Measuring Power Usage at the Equipment Level • Looked for some equipment documentation on actual power usage. • Generally speaking, the documentation only provided rating factors for the circuit breakers. • Blade servers were the exception, they provided actual power calculators. • Looked online (and the CMG proceedings) for articles providing this kind of information. • Came up empty.

10. Measuring Power Usage at the Equipment Level • Pursued two efforts in parallel • Captured before and after power readings at the UPS level for any change that projected a 5KW or greater impact • Worked with staff at a newer Data Center that had the capability to provide circuit level power usage profiles • Developed spreadsheet of findings and created some initial forecasts

11. Measuring Power Usage at the Equipment Level • Initial forecasts tended to underestimate the impact of power events. • Part of the learning curve for this type of analysis. • A ‘life cycle’ usage profile for equipment types began to emerge from the dual measurement efforts being conducted.

12. Measuring Power Usage at the Equipment Level

13. Measuring Power Usage at the Equipment Level

14. Measuring Power Usage at the Equipment Level

15. Reporting and Forecasting Techniques • All data capture and analysis was done in EXCEL, nothing fancy. • Experimented with a variety of reporting techniques before we came up with the final set of reports.

16. Reporting and Forecasting Techniques

17. Reporting and Forecasting Techniques

18. Reporting and Forecasting Techniques

19. Summary • Primary goal of the paper was to share some lessons learned. • Power analytics are fairly straightforward. • The data can be elusive and difficult to get. • The paper contains a table of power factors developed over time.

21. The End • Questions???