1 / 20

Java API for SEE-GRID File Management: Overview & Configuration

Learn about the SEE-GRID File Management Java API for data management operations, installation, and configuration steps. This API supports file uploading, downloading, replication, deletion, and more.

lfarina
Download Presentation

Java API for SEE-GRID File Management: Overview & Configuration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The gLite API – Part II Giuseppe LA ROCCA INFN Catania giuseppe.larocca@ct.infn.it ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia

  2. S E E-G R I D File Management J a v a A P I ver 1.3 • Overview of the SEE-GRID File Management Java API • Requirements & Configuration • The Classes : LFCDataStorage, LFCDirectoryItem and LFCFileItem • Hands-on

  3. Overview of the gLite DM API

  4. Overview SEE-GRID File Management Java API supports most of the data management operations offered by LFC and LCG_UTILS C APIs. These Java API are compatible with LCG 2.7.x and gLite grid middleware. The initial version was created within SEE-GRID project

  5. Available feature(s) Uploading / Downloading files from UI to grid Reading file information: permissions, GUID, comment Listing file replicas File management operations: replicating files, deleting files and file replicas, unregistering files and file replicas Reading directory information Permissions, comment Listing directory contents Reading user and group ids for files and directories Reading user and group names for files and directories • Reading filemode information as described in LFC C/C++ API manual • Listing file/directory aliases • Alias management operations (create/rename/delete) • Reading file/directory date information • Additional file management operations (rename/move) • Directory management (create/rename/move) • File/directory comment modification • Listing of SE from BDII with the ability to ignore some SEs set in a properties file • Directory management (delete)

  6. Installation and Configuration /1 0.) First of all you have to install the following APIs: GFAL C/C++ API lcg_util C/C++ API LFC C/C++ API gLite FTS Java API 1.) Then you have to download the SEE-GRID File Management API (see references) These APIs come with the last release of gLite middleware and should be already installed and configured by your sys-admin.

  7. 2.) Set the CLASSPATHvariable to contain the path of the SEE-GRID File Management API. Set the value of the VO variable with the name of your Virtual Organization Set the value of bdii.host.nameand bdii.host.port Optionally, set the value of property SE.ignore.list with the list of SEs to be ignored when obtaining availables SEs from the BDII. Installation and Configuration /2

  8. $ cat repmngr.properties e.o, LFest Java API properties. This file's location needs to be in classpath. # # Name of Virtual Organisation VO = gilda # List of available Storage Elements SEList = iceage-se-01.ct.infn.it aliserv6.ct.infn.it se.hpc.iit.bme.hu gilda-02.pd.infn.it fn2.hpcc.sztaki.hu # List of Storage Elements to ignore even if published SE.ignore.list = egee016.cnaf.infn.it bdii.host.name = gilda-bdii.ct.infn.it bdii.host.port = 2170

  9. 3.) Set the LCG_GFAL_INFOSYSandLFC_HOSTvariables as follow: export LFC_HOST=lfc-gilda.ct.infn.it export LCG_GFAL_INFOSYS=gilda-bdii.ct.infn.it:2170 Installation and Configuration /3

  10. LFCDataStorageclass is an implementation of DataStorageInterface which provides information and access to data storage resources of a grid.

  11. LFCDirectoryItemclass provides methods to retrieve directory information and data management.

  12. LFCFileItemclass provides methods to retrieve file information and data management.

  13. Listing directory content of a LFC $ java LfcLs /grid/gilda/ drwxrwxr-x 124 104 0 aula_grid drwxrwxr-x 124 104 0 aula_grid_11 drwxrwxr-x 152 104 0 balasko drwxrwxr-x 137 104 0 cdg drwxrwxr-x 129 104 0 clermont drwxrwxr-x 101 104 0 corsogrid drwxrwxr-x 112 117 0 emidio [..cut..]

  14. Retrieve list of SE(s) from the BDII

  15. Copy and register file(s) on the SE

  16. $ java copyAndRegister /home/larocca/HEPIX/Api-Java-LFC-1.3/compile-exercises.sh \ /grid/gilda/tutorials \ compile-exercises.sh \ aliserv6.ct.infn.it File /home/larocca/HEPIX/Api-Java-LFC-1.3/compile-exercises.sh copied and registed as: /grid/gilda/tutorials/compile-exercises.sh Copy and register file(s) on the SE /2

  17. Replicating files

  18. $ java replicate Replicate file to given SE. Usage: java replicate <gridDestFileName> <target_SE> $ java replicate /grid/gilda/tutorials/compile-examples.sh vega-se.ct.infn.it Replication successful: true Replicating files

  19. References SEE-GRID File Management Java API Documentation http://grid02.rcub.bg.ac.yu/LFCJavaAPI/files/docs/javadoc/version1.3/index.html Source code (version 1.3) [released 11/07/2007] http://grid02.rcub.bg.ac.yu/LFCJavaAPI/files/downloads/SEE-GRIDFileManagementAPI-v1.3.zip

  20. Hands-on $ cd ${HOME}/Api-Java-LFC-1.3 To compile Java code run: $ source compile-exercises.sh • Connect to the training infrastructure using the information reported in the tutorial sheet • Run the hands-on available in this web link: http://www.euasiagrid.org/wiki/index.php/WMProxy_Java_API • Enjoy!

More Related