1 / 12

HRM use in STAR US Atlas/RHIC Grid Workshop March 18, 2004

HRM use in STAR US Atlas/RHIC Grid Workshop March 18, 2004. Eric Hjort, LBNL (STAR/PPDG Collaborations). - SRM’s in general -HRM’s in STAR -CLI examples. What are SRMs?. Grid middleware developed by the Scientific Data Management (SDM) Resource Group, LBNL

ova
Download Presentation

HRM use in STAR US Atlas/RHIC Grid Workshop March 18, 2004

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HRM use in STARUS Atlas/RHIC Grid WorkshopMarch 18, 2004 Eric Hjort, LBNL (STAR/PPDG Collaborations) -SRM’s in general -HRM’s in STAR -CLI examples Eric Hjort

  2. What are SRMs? • Grid middleware developed by the Scientific Data Management (SDM) Resource Group, LBNL • Examples of SRMs (Storage Resource Managers) Disk Resource Managers (DRMs) Tape Resource Managers (TRMs) Hierarchical Resource Managers (HRM = TRM+DRM) • API and CLI are supported • For STAR: HRMs make the complicated 3-step transfer: HPSS – disk – disk - HPSS look like a simple copy. Details of cache management, request queuing, fault recovery, etc. are hidden. Eric Hjort

  3. Eric Hjort

  4. Main advantages of using SRMs(courtesy SDM group) • Same uniform interface to all types of storage systems • Disk Storage System • Mass Storage System • For Mass Storage Systems it provides: • Queuing and pre-staging • Queued multi-file “get” requests (avoid flooding MSS) • Pre-staging of files (concurrent with transfer) • Queued archiving of “put” requests (avoid flooding MSS) • Robustness and efficiency • Recover in case of transient failures from MSS • Reorders pre-staging requests to minimize tape mounts • Recovery from failed GridFTP transfers • Re-issues requests in case of failure Eric Hjort

  5. Star File Replication: Overview mysql BNL File Catalog BNL FC Mirror mysql LBL FC Mirror LBL FC metadata data HRM Files Files BNL LBL Eric Hjort

  6. RRS Registration Replica Service mysql BNL File Catalog BNL FC Mirror mysql LBL FC Mirror LBL FC HRM Files Files BNL LBL Eric Hjort

  7. Architecture(from Alex Sim) Not shown - step 10: notify RRS server of completed transfer Eric Hjort

  8. Transfer Schematic File Released PFTP->HPSS done PFTP->HPSS start HPSS request GridFTP end GridFTP start Space Reserved Request Submitted Time (seconds) - As seen from the HRM at LBL - (525 MB/file)(56 files)/7000 sec = 4.2 MB/s Eric Hjort

  9. CLI example 1 Copy the entire contents of a directory, subject to a wild-card search: srm-copy.linux -conf hrm.rc -sd "srm://stargrid03.rcf.bnl.gov:XXXX /home/starsink/raw/daq/2004/011/st_physics_adc_5011048_raw_1* ?remoteobj=HRMServerBNL&msshost=hpss.rcf.bnl.gov&mssport=XXXX" -td "srm://garchive.nersc.gov/nersc/projects/starofl/raw/daq/2004/011" -at PLAIN -et GSI -al starpftp -ap “fakePWD" - Recursive and conditional transfers also supported Eric Hjort

  10. CLI example 2 Supply SRM with a file list: srm-copy.linux -d -f daq.get -c /auto/u/hjort/hrm2/hrm.rc -l daq.log -w -at PLAIN -et GSI -al starpftp -ap “fakePWD" daq.get: (sourceURL, size, targetURL) srm://stargrid03.rcf.bnl.gov:XXXX /home/starsink/raw/daq/2004/015/st_physics_adc_5015002_raw_1030001.daq ?remoteobj=HRMServerBNL&msshost=hpss.rcf.bnl.gov&mssport=XXXX 525349883 srm://garchive.nersc.gov/nersc/projects/starofl /raw/daq/2004/015/st_physics_raw_1030001.daq • - File lists created by comparing BNL mirror catalog and HPSS • Useful for getting missing files, completing crashed transfers, etc. Eric Hjort

  11. CLI example 3 Get files off of NFS disks instead of HPSS: srm-copy.linux -d -f disk_ppLong-1FullFieldP03ih.get -c /auto/u/hjort/hrm2/hrm.rc -l disk_ppLong-1FullFieldP03ih.log disk_ppLong-1FullFieldP03ih.get: gsiftp://stargrid03.rcf.bnl.gov/star/data16 /reco/ppLong-1/FullField/P03ih/2003/150 /st_physics_4150010_raw_0020078.MuDst.root 23315827 srm://garchive.nersc.gov/nersc/projects/starofl /reco/ppLong-1/FullField/P03ih/2003/150 /st_physics_4150010_raw_0020078.MuDst.root Advantage: NFS access typically faster than HPSS Eric Hjort

  12. Final Notes • SRMs have served STAR well for ~2 years – transferred • many 10’s of TB. SRMs allow improved efficiency, • robustness and automation. - SRM V2 due out later this year (web services) - For more info, see the SDM site: http://sdm.lbl.gov/ and in particular the SRM pages: http://sdm.lbl.gov/projectindividual.php?ProjectID=SRM Eric Hjort

More Related