1 / 22

GFAL/LCGUTIL to GFAL2/GFAL2 migration

GFAL/LCGUTIL to GFAL2/GFAL2 migration. Alejandro Alvarez Ayllon on behalf of the DM Clients developers. Remember remember the 1 st of November. The 1 st of November. GFAL/LCGUTIL will not be supported They will be removed from Fedora/EPEL

tameka
Download Presentation

GFAL/LCGUTIL to GFAL2/GFAL2 migration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GFAL/LCGUTILtoGFAL2/GFAL2 migration Alejandro Alvarez Ayllon on behalf of the DM Clients developers

  2. Remember remember the 1st of November

  3. The 1st of November • GFAL/LCGUTIL will not be supported • They will be removed from Fedora/EPEL • Fear not! We will give support for migration indefinitely

  4. Release cycle for gfal2 components Merges EPEL Testing Development RC EPEL • Increase of minor version • New functionalities • Non critical bug fixes • Nightly tests • Deployed in the FTS3 Development Services • Increase of release number • “Quarantine” stage of a release • Packaging fixes • Critical patches • Beta testers welcome! • Increase of revision number • Critical bug fixes • Deployed in the FTS3 Pilot Service • Full production release

  5. Getting started

  6. Installation • Enable EPEL (5, 6 or even 7!) • Install • gfal2-all • Core + Transfer, DCAP, GridFTP, HTTP/DAV, LFC, RFIO and SRM • gfal2-python • gfal2-util • gfal2-plugin-xrootd for xrootd support

  7. Fast check $ voms-proxy-init --vomsdteam $ gfal-ls gsiftp://lxfsra04a04.cern.ch/dpm/ drwxr-xr-x 0 0 0 Jul 12 2013 0 cern.ch

  8. Command Line Interface Side by side

  9. Two Swiss Army Knifes: gfal-copy LFC is not a special citizen, but some operations can be mapped easily Registration = COPY

  10. # Copy & Register (lcg-cr) gfal-copy file:///local/file gsiftp://se.cern.ch \ lfc://lfc.cern.ch/lfn # Copy & Register (lcg-rep) gfal-copy gsiftp://se-a/path gsiftp://se-b/path lfc://lfc.cern.ch/lfn # Register a file (lcg-rf) gfal-copy gsiftp://se/path lfc://lfc.cern.ch/lfn

  11. Two Swiss Army Knifes: gfal-xattr • Get/set extended attributes: key => value • Some “special” mappings • user.replicas • user.guid • user.comment • spacetoken • spacetoken.token?<token> • spacetoken.description?<description>

  12. Examples

  13. GFAL2 Python API Side by side

  14. GFAL: Less Pythonic importgfal gfalDict = {‘surls’: ‘srm://…’} err, obj, msg = gfal.gfal_init(gfalDict) ret, buff, msg = gfal.gfal_ls(obj) gfal.internal_free(obj)

  15. GFAL2: More Pythonic import gfal2 ctx = gfal2.creat_context() try: ctx.listdir(‘srm://…’) except gfal2.Gerror, e: print“[%d] %s” % (e.code, e.message)

  16. Remote random IO supported too, and thread safe!

  17. Copy a file • ctx.filecopy(params, source, dest) • Params is an instance of ctx.transfer_parameters • Members • checksum_check • set_user_defined_checksum(algo, value) • dst_spacetoken • event_callback • monitor_callback • nbstreams • overwrite • src_spacetoken • timeout

  18. Examples Check our repository https://svnweb.cern.ch/trac/lcgutil/browser/gfal2-bindings/trunk/example/python

  19. Do not forget • Supported protocols • SRM • GridFTP • HTTP/DAV • LFC • RFIO • DCAP • XROOTD New DM Clients and retirement plans for old ones

  20. Questions?

More Related