1 / 15

Mobile Management of Network Files

Mobile Management of Network Files. Alex Bassi Micah Beck Terry Moore Computer Science Department University of Tennessee. Logistical Networking. Technology for shared network storage that can scale in terms of the size of the user community,

monet
Download Presentation

Mobile Management of Network Files

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Mobile Management of Network Files Alex Bassi Micah Beck Terry Moore Computer Science DepartmentUniversity of Tennessee

  2. Logistical Networking • Technology for shared network storage that can scale in terms of • the size of the user community, • the aggregate quantity of storage that can be allocated, and • the breadth of distribution of service nodes across network borders • Parallels layered IP networking stack

  3. Bottom-up Design Philosophy • The lowest globally accessible network layer in the network storage stack should • Enable scalable Internet-style resource sharing • Expose underlying storage resources in order to maximize freedom at higher levels • Standard network storage systems fails in some degree to satisfy one or both criteria.

  4. Servers that make allocation of primitive “byte arrays” available to clients Byte arrays are not blocks (more abstract) Network capabilities (primitive security) Variable extents Byte arrays are not files (weaker semantics) Size & duration are limited “Volatile” allocations Best effort reliability and availability No directory structure, accounting No caching, replication Internet Backplane Protocol (IBP)

  5. Primary UT Investigators Micah Beck James S. Plank UT Research Staff Alex Bassi Terry Moore Funding DOE Next Generation Internet & SciDAC NSF Next Generation Software Logistical Computation and Internetworking (LoCI) project w/ Birman, Dongarra, Wolski UT Graduate Students Wo Ling Yong Xiang Erica Fuentes Anthony Burton The Logistical Networking Project at the University of Tennessee

  6. Network Weather Service (UCSB) Rich Wolski Martin Swany NetSolve (UT ICL) Jack Dongarra Michelle Miller L-Bone & LoFS (UT) James S. Plank Application Level Scheduling (UCSD) Fran Birman Henri Casanova Graziano Obertelli Tamanoir (Université Claude Bernard Lyon 1 ) Laurant Lefavre Collaborating Projects

  7. Building on IBP • Many applications assume file semantics • Unbounded size & duration • High reliability & availability • Caching & replication • In a layered architecture, these are implemented through aggregation and additional intelligence at the next level

  8. Enter the exNode • In the Unix file system, blocks are aggregated into files using the intermediate node data structure, or inode • We implement file semantics on top of IBP using the external node (exNode) data structure • Aggregation of IBP byte array allocations • Additional metadata to enable management

  9. ExNode vs inode IBP Allocations the network local system capabilities exNode user kernel inode block addresses disk blocks

  10. A set of mappings and associated metadata A mapping associates a data extent and a temporal extent with a (set of) storage resource(s). Minimal container API constructor & destructor add mapping enumerate Lookup functions get byte extent get event list The exNode is a Set

  11. The exNode is Mobile Code!(files are structured processes) • Mappings are location-independent • XML serialization enables interoperability • The state of file system processes can be captured in an abstract, portable form • Mobile files can be freed of directory, operating system, accounting boundaries

  12. Example: IBP Mail SMTP exNode sender receiver IBP write IBP read IBP copy

  13. File System Services • Indirection to preserve integrity • Temporal and data extent aggregation • Reliability through RAID, replication • Performance through locality

  14. Active Services Active Probing to Maintain Fault Tolerance Lease Renewal Defragmentation Asynchronous Transfer Management Active File Management Defragmentation

  15. Conclusions • The Internet Backplane Protocol provides a fabric for network state management • Scalable and ubiquitous sharing are enabled by weak semantics & minimal accounting • The exNode & serialization provide a mobile abstraction of storage aggregation • Active file services can span OS & FS boundaries (Log Structured Logistical FS)

More Related