1 / 68

Storage Resource Broker

Storage Resource Broker. Command Line User Interface George Kremenek kremenek@sdsc.edu. SRB API Interface. User/shell script. MCAT. SRB Master. SRB Command Line Interface. Environment File. USER. SRB “shell” commands: Sls, Scp, Scat, Sput, Sget,. MCAT. SRB Agent. Proxy operation.

darrin
Download Presentation

Storage Resource Broker

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Storage Resource Broker Command Line User Interface George Kremenek kremenek@sdsc.edu

  2. SRB API Interface User/shell script MCAT SRB Master

  3. SRB Command LineInterface Environment File USER SRB “shell” commands: Sls, Scp, Scat, Sput, Sget, ... MCAT SRB Agent Proxy operation

  4. cat ~/.srb/.MdasEnv cat ~/.srb/.MdasAuth Shelp alias Sman ' /usr/bin/man -M /projects/diglib/srb/SRB1_1_7/utilities/man' Sman Sinit Lesson 1

  5. mdasCollectionHome '/home/kremenek.npaci' mdasDomainHome ‘npaci' srbUser 'kremenek' srbHost ’srb.sdsc.edu‘ srbPort ‘5615’ ~/.srb/.MdasEnv file

  6. valid authorization schemes are : 'PASSWD_AUTH', ‘ENCRYPT1','GSI_AUTH' defaultResource 'dl1-unix-sdsc’ File ~/.srb/.MdasAuth contains the SRB password .MdasEnv, .MdasAuth

  7. Sinit –v Spwd Senv Shelp Spasswd Serror -3219 Sinit

  8. describes SRB errors takes an error number generated by SRB/MCAT system and displays a text human readable message relating to the error Serror number

  9. changes password of current user changes the current user's password both in the Meta Catalog as well as in the Client Authorization Environment file password change persists across sessions with SRB Spasswd

  10. Sexit Sman Spwd Sattrs SRB objects. Sexit

  11. Simple File Ingestion and Access cat /tmp/SP2.srb Smkdir SP2 Sls -l SgetColl SP2 Sls -l SP2 Scd SP2; Spwd Lesson 2

  12. Smv remote_text_file remote_text_file2 SgetD remote_text_file2 Srm -pr SP2 Spwd Sls -l Smkdir SP2 Sls –l; Srmdir SP2; Sls -l Collections

  13. {[-N] collection} creates a new SRB collection is a format <path_name>/<new_collection_name>. -N option overrides the default association with container of its parent collection Smkdir {s+l}

  14. changes the working SRB collection without a collection the mdasCollectionHome value in the ~/.srb/.MdasEnv file will become the new working collection. Spwd - displays current working SRB collection Scd [collection], Spwd

  15. {[-fpra] [-c container] [-D dataType] [-S resourceName] [-P pathName] localFileName|localDirectory ... TargetName} imports one or more local files and/or directories -p prompts, -f force, -a force all replica,-r recursively, -c container Sput {s+l}

  16. Sput -rf /tmp/SRB1 . Sls –l; Sls -l SRB1 Sls -l SRB1/SRB2 Sls -l SRB1/SRB3 Sls -l SRB1/SRB3/SRB4 Sls -l SRB1/SRB3/SRB5 Scat SRB1/SRB3/SRB4/test4 Recursive Put

  17. {[-n n] [-pfr] [-A condition] srbObj|Collection ... localFile|localDirectory} exports one or more objects from SRB space into local file system -A option, only srbObj which conform to the condition are chosen. Sget {switches+list}

  18. Sget -rf SRB1 . find SRB1 -print # cleanup \rm -r SRB1 Srm -r SRB1 Spwd Sls -l Srm "*emote_text_?ile*" Recursive Get

  19. {[-hl] [-L number] [-r|-f] [-A condition] [collection|srbObj ...]} display and properties of objects -r recursively for sub-collections, -f force argument to be interpreted as a collection.-l long format, giving owner, replica #, physical resource, siz, time of creation Sls {s+l}

  20. {[-C n] [-T ticketFile | -t ticket] [-A condition] srbObj …} reads each srbObj from SRB to stdout -A option, only srbObj which conform to the condition are chosen If using a ticket, one need not give a srbObj name Scat {switches + list}

  21. rm -f local_text_file date > local_text_file Sput -vf local_text_file remote_text_file1 Sls –l; Sls –l remote_text_file1 Spwd; Scat remote_text_file1 SgetD remote_text_file1 Sget -vf remote_text_file1 /tmp Store and Retrieve Data

  22. lists the queriable MCAT attributes used in conditions for choosing SRB objects. Sattrs

  23. Srm Sls Srmdir Sls Srm –r Sls Lesson 3 Simple Cleanup

  24. {[-p] [-A condition] srbObj …} {[-p] [-A condition] -r srbObj|collection …} remove files from SRB space -p prompts, -r recursively (the collection will be emptied of datasets and removed), -A condition options(“"<Attr><CompOp> <Value>””) Srm {s+l}

  25. deletes an existing SRB collection Srmdir collection

  26. SgetR Stoken SgetU SgetD SgetColl Lesson 4 System Metadata Discovery

  27. {[-pPhdatg] [-L number] [-Y number] [-T userType] [userName@domainName]} displays information about a group or user userName@domainName -p user/group name, -a access permissions, -d domain(s), -t audit info. -g group(s), -c collection access, -T info. for user type SgetU {switches+list}

  28. SgetR du-unix SgetR -L 9999 | more SgetR -L 9999 | grep 'du-' Resources

  29. {[-phPrReasdDc] [-I] [-W | -U userName] [-Y number] [-L number] [-P dataType] [-A condition] [dataName]} display information about SRB data objects -p basic parameters, -r storage information, -a permissions, -d audit info., -c collection info., -W for all users, -Y [number] format SgetD {switches+list}

  30. {[-lhdDp] [-L number] [-Y number] [-T resourcTy pe] [resourceName]} display information about SRB resource(s) -l display comprehensive list, -d list objects, -D with details, -p for physical resources only,-T resource type list for the given type, -Y [number] controls display format SgetR {switches+list}

  31. Scp Smv Sreplicate Scp –r Smc <collection> Sphymv Sput <logical resource> Lesson 5 Data Movement and Data Replication

  32. {[-n n ] [-fpra] [-c container] [-S newResourceName] [-P newPathName] srcObj destObj srcObj ... target collection -r source collection... target collection } -p prompts, -f force, -a force all replica, -r copy recursively, -n replica number Scp {switches + list}

  33. {-n replicaNum] [-pr] [-S resourceName] [-P pathName] srbObj|collection …} makes one more copy of srbObj or collection -p prompts, -r recursively, -n replicaNum, -P full or relative newpathName to move the object, -S new resourcename Sreplicate {s+l}

  34. {srbObj targetObj} {collection newcollection} {srbObj ... Collection} Smv {s+l}

  35. {[-C n] [-p] [-P newpathName] srbObj ... newresourceName} moves one or more SRB objects to the newresourceName at new path newpathName (if given ). The old copy is deleted and the MCAT catalog is also updated Sphymove {s+l}

  36. Sattr Scat RTYPE Scat COPY Scat RESOURCE Scat [without one server] Lesson 6 Accessing Replicated Data

  37. Sput -vf local_text_file remote_text_file SgetD remote_text_file Sreplicate -S "du-sdsc-hpss" remote_text_file SgetD remote_text_file Sreplicate -S "du-caltech-hpss" remote_text_file Sls -l SgetD remote_text_file Srm -n 0 remote_text_file Replication

  38. Schmod SmodD SmodColl Lesson 7 Modifying System Metadata

  39. {[-c] [-a] [-p] [-r] [-d|c] w|a|r|n newUserName domainName collection| srbObj …} grants/changes access permits for the operand collection or srbObj ... for newUserName in domainName granted new permission for all replica Schmod {switches+list}

  40. {[-ahc] [-I] [-W | -U userName] [-Y number] [-L number] [-A condition] [collName]{ display information about SRB data objects -a display permissions, -W all users, -c container, -U for usr/group,-I in all collections, -Y output format, -A condition option "<Attr> <CompOp> <Value>" SgetColl {switches+list}

  41. {-s|-t|-c newValue dataName} modifies metadata information about SRB data objects -s change size -t change type -c insert comments SmodD {s+l}

  42. Smeta <ingest for data> Lesson 8 User-defined Metadata

  43. {-w position annotation dataName} {-u timestamp newAnnotation dataName} {[-R] [-t timestamp] [-p position] [-U userName@domainName] [-Y n] [-L n] [-T dataType] dataName|collectionName} facility for annotations on data objects Sannotate {switches}

  44. modifies metadata information about SRB data objects {-i -I metaAttrNameEqValue [ [-I metaAttrNameEqValue] ... ] dataName} {-u metadataIndex metaAttrNameEqValue dataName} {-d metadataIndex dataName} {-c -i -I metaAttrNameEqValue [ [-I metaAttrNameEqValue] ... ] collectionName} {-c -u metadataIndex metaAttrNameEqValue collectionName} Smeta {s+l}

  45. {-c -d metadataIndex collectionName} {[-R] [-I metaAttrNameOrCondition [-I metaAttrNameOrCondition] ... ] [-Y n] [-L n] [-T dataType] dataName|collectionName} {-c [-R] [-I metaAttrNameOrCondition [-I metaAttrNameOrCondition] ...] [-Y n] [-L n] [-T dataType] [collectionName]} Smeta cont.

  46. Smeta provides facility for inserting,deleting, updating and accessing meta-data on data object dataName or collection collectionName Currently, we support 10 string attributes and two integer attributes 'all’ permission for modify, 'read’ for view Smeta cont.

  47. {[-dh] -c value collName} modifies information about collections in collName -h help, -d delete, -c container_name is updated SmodColl {s+l}

  48. Containers Lesson 9

  49. {[-S resourceName] [-D dataType] [-s containerSize] container} creates a new SRB container “container" may be an absolute path or a relative path (will be created in the user's container collection path - /container/userName.domainName) Smkcont {s+l}

  50. {[-a] [-l]} or {container} display metadata of SRB containers “Slscont” displays all containers “Slscont XYZ” all inContainer objects will be listed -l metadata in long format,-a accessible by the user rather than owned by the user Slscont {s+l}

More Related