1 / 18

Impact of the convergence of three worlds: High-Performance Computing, Databases, and Analytics

Impact of the convergence of three worlds: High-Performance Computing, Databases, and Analytics. Stefan Manegold Stefan.Manegold@cwi.nl http://www.cwi.nl/~manegold/. HPC (!). Database. Analytics (?). Cluster. http://www.scilens.org/. Our new Playground & Challenge.

jeslyn
Download Presentation

Impact of the convergence of three worlds: High-Performance Computing, Databases, and Analytics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Impact of the convergence of three worlds: High-Performance Computing, Databases, and Analytics Stefan Manegold Stefan.Manegold@cwi.nl http://www.cwi.nl/~manegold/

  2. HPC (!)

  3. Database

  4. Analytics (?)

  5. Cluster http://www.scilens.org/

  6. Our new Playground & Challenge 1+ diamonds: 64+ cores, 4+ TB RAM, X GPUs, Y TB SSD, Z ... 16 rocks: 2x 8-core HT Xeon, 256 GB RAM, 4+ GPUs, 8 TB HDD, 2 TB SSD; 48 TB NAS 512 cores, 4 TB RAM, 4+ GPUs, 128 TB HDD, 32 TB SSD; 48 TB NAS 128 bricks: 4-core HT i7, 16GB RAM, 2 TB HDD, 1 TB SSD 1024 cores, 2 TB RAM, 256 TB HDD, 128 TB SSD 128 Pebbles: dual-core AMD bobcat, 8GB RAM, 10 TB HDD 256 cores, 1 TB RAM, 1.3 PB HDD

  7. The Memory Wall

  8. The Memory Wall Trip to memory = 1000s of instructions!

  9. Larger, faster, cheaper and more responsive memory sub-systems+memory-optimized DBMS=...

  10. In the multi-core age, how do larger, faster, cheaper and more responsive memory sub-systems affect data management?

  11. In the multi-core age, how do larger, faster, cheaper and more responsive memory sub-systems affect data management? In the age of larger, faster, cheaper and more responsive memory sub-systems, how do multi- (or even many-) core systems affect data management?

  12. Shopping List Excerpt Bandwidth bottleneck: How to feed all these cores? How to exploit excess CPU cycles usefully? Exploit TurboBoost: Instructions per data dependent MPL Energy consumption: WATTs per GB of DRAM vs. Flash vs. Disk System maintenance and opertation: How to bootstrap a multi-TB (PB?) RAM system? Hot-swapable DRAM? ...

More Related