140 likes | 256 Views
Enabling Hardware Technology for Web Science. John Kim Department of Computer Science KAIST. Computing System. Moore’s Law. Increasing number of cores. Challenges for Future Hardware. Energy-Efficient Mobile Systems Need to extend battery life
E N D
Enabling Hardware Technology for Web Science John Kim Department of Computer Science KAIST Web Science & Technology Forum
Computing System Web Science & Technology Forum
Moore’s Law Web Science & Technology Forum
Increasing number of cores Rethinking the Design of Interconnection Networks
Challenges for Future Hardware • Energy-Efficient Mobile Systems • Need to extend battery life • Provide the performance capability of a laptop with a smaller power budget • Exploit parallelisms available in future multi/many-core processors • Scalable Datacenter • Future datacenters will continue to increase in the number of servers interconnected • Need to minimize energy consumption Web Science & Technology Forum
Energy Consumption Source: C. Belady “In the data center, power and cooling costs more than the it equipment it supports” • Datacenters have a huge electricity bill • e.g.) US datacenters will consume 100 billion kWh at a cost of $7.4 billion per year [EPA report] • Total cost of ownership is no longer dominated by the hardware but by Energy-Efficient Datacenters
Which costs more? 20mm Web Science & Technology Forum
Supercomputers to Datacenters Web Science & Technology Forum
Can we leverage the network used in high-performance computing for datacenter networks? funded in part by Microsoft Research Asia Web Science & Technology Forum
Existing approaches Scale up High end router TOR switches Container0 Container1 ... With the number of servers growing Scale out TOR switches slide from C. Guo With the number of servers growing • Tree • Oversubscribed • Bottlenecked root • Fat tree • 1:1 subscription • Costly as large number of switches
Flattened Butterfly John Kim, William Dally, Dennis Abts, “Flattened Butterfly: Cost-Efficient High-Radix Networks” ISCA 2007 Rethinking the Design of Interconnection Networks
Dragonfly Topology [ISCA’08] • Increase scalability by using a collection of routers as a ”supernode” • Leverage the packaging hierarchy found in systems to match the hierarchical network of the topology? • What is the challenge of mapping this topology? Adaptive Routing Web Science & Technology Forum
Packaging Hierarchy Rackable Systems Container Web Science & Technology Forum
Load-Balanced Routing Load-balancing required in both inter- and intra-container routing Randomized routing can be leveraged to load balance the channels Adaptive routing need to determine whether to route using minimal routing and nonminimal routing Approach : - Leverage the centralized management capability in datacenters and provide a centralized adaptive routing. - Focus on load-balancing the “elephant” flows while other short-lived flows can be routed minimally Web Science & Technology Forum