1 / 5

HSM at 222

HSM at 222. James Bellinger University of Wisconsin at Madison 28-June-2011. StorHouse System at 222. RFS Client (1 or more). Tape Robot. StorHouse System. Data integrity Disk for high availability Virtual file system Aggregate files into 2GB collections.

lazar
Download Presentation

HSM at 222

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HSM at 222 James Bellinger University of Wisconsin at Madison 28-June-2011

  2. StorHouse System at 222 RFS Client (1 or more) Tape Robot StorHouse System Data integrity Disk for high availability Virtual file system Aggregate files into 2GB collections Virtual file system served as NFS to clients Metadata management Data mover Disk pool for fast access 1080 LT04 6 drives allocated Clients

  3. Operation for “ls” Translate to NFS RFS Client (1 or more) Tape Robot StorHouse System Poll metadata DB and return Prepare request for database Answer ls /hsm/EXP/2005/AMANDA Clients

  4. Logic for ‘read’ • Client asks to read NFS-mounted user file via RFS client • RFS-client maps NFS to RFS user file • Is user file present on RFS? If yes, return it to the client • Send metadata request to StorHouse • If user file does not exist, return error toRFS client which returns error to client • Find collection userfile is in. If not on disk already, request tape from robot and copy the collection to disk • Send collection and checksum to RFS client • RFS client unpacks the collection into user files and checksums the file • If checksum is OK, return user file to the client

  5. Limitations RFS Client (1 or more) Tape Robot StorHouse System File unpacking and integrity limits speeds to O(30MB/sec) 1 ingest node per database set Logical groupings in directory trees, access speed split among accesses to given logical group Virtual file system served as NFS to clients Single system for metadata 1 mover node for all drives CPU use suggests no more than 5 accesses at a time Clients

More Related