1 / 21

0 KB MB GB TB

0 KB MB GB TB. 0 KB MB GB TB. 0 KB MB GB TB. 0 KB MB GB TB. 10 -8 10 -4 1 10 4 10 8. 10 -8 10 -4 1 10 4 10 8. Number of jobs. 1.0 PB 0.5 PB 0. Map + Reduce data size. Jobs submitted.

hamal
Download Presentation

0 KB MB GB TB

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 0 KB MB GB TB 0 KB MB GB TB

  2. 0 KB MB GB TB 0 KB MB GB TB 10-8 10-4 1 104 108 10-8 10-4 1 104 108

  3. Number of jobs 1.0 PB 0.5 PB 0 Map + Reduce data size Jobs submitted Jobs submitted Sum data size Sum data size 20 TB 10 TB 0 1.0 PB 0.5 PB 0

  4. Number of jobs 20 TB 10 TB 0 Map + Reduce data size

  5. 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB

  6. 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB

  7. 0 KB MB GB TB 0 KB MB GB TB 0 KB MB GB TB

  8. Input data in DFS Shuffle Map 1 Output data in DFS Partition 1 Reduce 1 Partition 1 Map 2 Partition 2 Partition 2 Reduce 2 Partition 3 Map 3 Partition 3 Reduce 3 Partition 4 Map 4 Figure 1. The logical data and processing flow of a MapReduce job.

  9. Figure 2. Hourly job submissions over a week in a Facebook MapReduce workload.

More Related