1 / 16

Volunteer Computing and Hubs

David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013. Volunteer Computing and Hubs. Computing resources. Organizational. Consumer. desktop data center. PCs laptops mobile devices appliances. cluster, cloud, Grid, super computing.

ping
Download Presentation

Volunteer Computing and Hubs

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. David P. Anderson Space Sciences Lab University of California, Berkeley HUBbub September 26, 2013 Volunteer Computing and Hubs

  2. Computing resources Organizational Consumer desktop data center PCs laptops mobile devices appliances cluster, cloud, Grid, super computing desktop grid computing volunteer computing BOINC

  3. How BOINC works PCs (Windows, Mac, Linux, Android) projects nanoHUB Einstein@home attachment WCG

  4. It works best for… • Large bags of tasks • Throughput-oriented • Moderate RAM, disk usage • Moderate data/compute ratio • < 1 GB per hour

  5. Volunteer computing status • Volunteers: 400K people, 600K computers, 2M cores • > 50 science projects, e.g. • Climateprediction.net (Oxford) • Einstein@home (Max Planck Inst.) • IBM World Community Grid • “umbrella” project; MGI is one • > 15 PetaFLOPS, many million jobs/day • Potential: many ExaFLOPS

  6. Adding BOINC to Hubs Goal: increase the computing throughput available to Hub users • A Hub has an associated BOINC project • Large batches of jobs submitted to the Hub are run using the BOINC project • Hub users attach their PCs to the project • Project can be accessible to the public

  7. BOINC Web RPC Interfaces • Remote job submission • get batch completion estimate • submit/query/abort batches • File management • content-based: only 1 copy of a given file • reference-counting, garbage collection

  8. Identity and access control • Each Hub user has a corresponding BOINC account • BOINC enforces access control for job submission

  9. User quotas • Each user has a “quota” determining the fraction of computing they get • May be set in proportion to • user’s computing contribution • other Hub contributions • BOINC’s job scheduling policy • do small batches before large ones • don’t starve large batches • enforce quotas over the long term

  10. Using VM technology • Heterogeneity of volunteer PCs • Difficult to port applications to all platforms

  11. BOINC VM-based apps • Developers work in environment of choice • App consists of • compressed minimal VM image (same across multiple apps) • executable • BOINC “Vbox wrapper” • Volunteers need to install VirtualBox

  12. How it works VirtualBox executive BOINC client VBox wrapper virtual machine shared directory

  13. VM bonuses • Vbox wrapper creates a “snapshot” every few minutes • free checkpointing • A VM is a strong security sandbox • can potentially deploy untrusted apps

  14. Implementation • Proof of concept in nanoHUB • VM with Tcl, Rappture library • Job submission via Web or workspace “submit” • Behind firewall for now • To do • Add “batch” notion to HUBzero • Use BOINC’s job-submission interfaces • Automate identity management

  15. Branding and marketing • How to market to volunteers? • Brand: nanoHUB@home or HUB@home? • Sometimes fewer brands are better BOINC projects Account manager nanoHUB@home nanoHUB@home Science@home nanoHUB@home

  16. Conclusion • HUBzero and BOINC are complementary • more computing power to scientists • more science options for the public • Contact • http://boinc.berkeley.edu • davea@ssl.berkeley.edu • BOINC Workshop • Grenoble, Sept 25-27 2013

More Related