70 likes | 174 Views
High Performance File System Service for Cloud Computing. Kenji Kobayashi, Osamu Tatebe University of Tsukuba, JAPAN. Towards Cloud File System. ○. Availability. ○. Maintainability. ✗. Compute Cloud physical machines (e.g. Amazon EC2). Application modification required
E N D
High Performance File System Service for Cloud Computing Kenji Kobayashi, Osamu Tatebe University of Tsukuba, JAPAN
Towards Cloud File System ○ Availability ○ • Maintainability ✗ Compute Cloud physical machines (e.g. Amazon EC2) Application modification required -REST, SOAP based protocol ✗ Low and Unstable Performance Expensive Cost for constructing -High bandwidth Network between EC2 and storage Storage Cloud disk array (e.g. Amazon S3) ✗ We propose file system service in Compute Cloud
Towards Cloud File System (2) migration replication remote access Gfarm File System merely using local disk ✗ ○ Availability Availability ✗ ○ • Maintenancability • Maintainability
Towards Cloud File System (3) Construct File system service using stable HostOS on physical machines the HostOS is the baseOS for managing VM. VM VM VM volatile VM VM difficult to utilize file access locality virtualized environment hides the underlying physical configuration HostOS HostOS HostOS HostOS HostOS stable need to solve this problem to take advantage of local file access
System Design • Construct Gfarm file system on compute cloud • Host OS provides functionality of I/O server • Create the physical configuration file dynamically • Take advantage of local access performance VM VM VM VM VM VM Gfarm client Gfarm client Gfarm client Gfarm client Gfarm client Gfarm client gfsd gfsd gfsd gfsd gfsd gfsd HostOS HostOS HostOS HostOS HostOS HostOS Need some mechanism to identifythe physical configuration Virtualized environment prevents to identify the Host OS running on physically same node
System Design (2) reply for message to access gfsd VM VM VM gfmd Gfarm client Gfarm client Gfarm client request metadata ・・・ Inform the mapping to metadata server gfsd gfsd gfsd Eucalyptus NC Eucalyptus NC Eucalyptus NC Mapping File <instance id=“i-xxxxxx”> <vm_ip_addr> 172.16.xxx.xxx </vm_ip_addr> <hostOS_ip_addr> 172.16.xxx.xxx </hostOS_ip_addr> ・・・ </instance> ・・・ HostOS HostOS HostOS real network Eucalyptus NC generatesmapping file dynamically