220 likes | 231 Views
VMFlock: VM Co-Migration Appliance for the Cloud. Samer Al-Kiswany With: Dinesh Subhraveti Prasenjit Sarkar Matei Ripeanu. Why VM Migration across Data Centers ?. For Cloud Users: Freedom, Not locked to one cloud. Private and public clouds. For the Cloud provider:
E N D
VMFlock: VM Co-Migration Appliance for the Cloud • Samer Al-Kiswany • With: Dinesh Subhraveti • Prasenjit Sarkar • Matei Ripeanu
Why VM Migration across Data Centers ? • For Cloud Users: • Freedom, Not locked to one cloud. • Private and public clouds. • For the Cloud provider: • Load balancing across data centers • Accommodate scheduled maintenance • Arbitration of energy cost Requires: Efficient migration and fast instantiation of VM still images across data centers.
Challenges • Applications often deployed on multiple VMs (VM Flock) • Large VM image size (GBs) • Limited WAN bandwidth • Strict Cloud API • Limited resources • (compute, memory, IO)
Opportunities • Similarities across VM flock images • Similarities across VM repositories • VM boot time access pattern
VMFlock Migration System An appliance for migrating and bootstrapping multiple VM images across data centers. • Properties: • High performance • Scalable • Load balanced • Easy to adopt • VMFlockMS achieves (compared to alternatives): • Up to 10x better compression rate • Up to 3.5x faster migration time
Outline • Introduction • VMFlockMS Design • Migration Appliance Design • VM Bootstrap component Design • Evaluation • Conclusion
VMFlockMS Design • Migration components • Similarities across VM flock images • Similarities across VM repositories • Bootstrap components • VM boot pattern Source Destination Migration nodes Migration nodes VM VM VMProfiler VMLaunchPad VM Repository VM Repository
Migration Components Design • Similarities across VM flock images • Similarities across VM repositories • Deduplication challenges: • CPU and IO intensive workload • Metadata size Source Destination Migration nodes Migration nodes VM Repository VM Repository
Migration Components Design Source Destination VM Repository
Migration Components Design Source Destination VM Repository
Migration Components Design Source Destination VM Repository
Migration Components Design Source Destination VM Repository VM Repository
VM VM VMProfiler VMLaunchPad Bootstrap Components Design Source Destination Migration nodes Migration nodes VM Repository VM Repository
Outline • Introduction • VMFlockMS Design • Migration Appliance Design • VM Bootstrap component Design • Evaluation • Conclusion
Evaluation – Setup • Images • Application: Spree e-commerce (spree, sql, storage node) – 7.9 GB • Same-OS (Fedora: desktop, developer, server, plain) – 10.6 GB • Diff-OS (Fedora, openSUSE, Ubuntu) – 10.6 GB • Alternatives • Gzip-All • Gzip-Separate (parallel Gzip) • Dedup-separate [Hirofuchi 09, Bradford 07, Sapuntzakis 02]
Evaluation – Setup • Testbed • 2 machines at Almaden and 2 at T.J. Watson • 1 machine at each side works as a VM repository Courtesy Google Maps
Evaluation – Compression Rate No VM images at destination Single VM image at destination Achieves up to 10x better compression rate.
Evaluation – Migration Time Migration time for the application flock VMFlockMS achieves up to 2x better migration time.
Evaluation – Migration Time Migration time for the application flock using the VM repository emulator (emulating 4 SAS disks) VMFlockMS achieves up to 3.5x better migration time.
Evaluation – Boot Time • VM Flock needs less then 20MB to boot. • Most of the data already at destination • VM flock boot in less than 1 min • VMFlockMS overhead less than 3%
Summary VMFlockMS: An appliance for migrating and bootstrapping multiple VM images across data centers. • Properties: • High performance • Scalable • Load balanced • Easy to adopt • Where else: • Scientific data sets migration • Long execution pipelines