Data Manipulation with Globus Toolkit

1. Data Manipulationwith Globus Toolkit Ivan Ivanovski TU München, 11. 2005 i.ivanovski@gmail.com

2. The Project Tasks • Introduce to Globus Toolkit 4 • Write GT4 Web Service • GridFTP • OGSA-DAI • Work with the existing CSCW Framework

3. Globus Toolkit – Introduction • Open-source-software developed by Globus Alliance • Includes • security, information infrastructure, resource, data management, communication, fault detection, portability.

4. Who uses Globus software • CERN – European Data Grid • GriPhyN • Network for Earthquake Engineering & Simulation • European System Grid

5. Globus Toolkit 4 – used components JAVA WS CORE GridFTP OGSA-DAI

6. Working with the Web Services • Standardized way of integrating web-based applications • XML, SOAP, WSDL and UDDI standards • over an internet backbone. • Independent (operating system / language) • 5 steps of creating Web Services

7. 5 Steps of Creating GT4 Web Service • Step 1 – Defining Service Interface • Step 2 – Implementing the Java Service • Step 3 – Configuring Deployment • Step 4 – Creating a GAR file • Step 5 – Deployment

8. OGSA-DAI = Open Grid Software Architecture – Data Access and Integration • Querying, Updating, Transforming, Delivering Data to Databases from a web service • Grid Environment

9. Deploying OGSA-DAI WSRF Data Services and Data Service Resources First the OGSA-DAI data service needs to be deployed with the following command: $ ant deployDataServiceGT4 -Ddai.service.path=service_path The next step is to deploy the data service resource. The command needs to be run from $OGSADAI_HOME and is as follows: $ ant deployResourceGT4 -Ddai.service.resource.file=mydata.service.resource.properties Then the file mydata.service.resource.propertiesneeds to be created and edited The final step is to add the data service resource to the data service: $ ant addResourceGT4 -Ddai.service.path=path_to_service -Ddai.resource.id=dai_resource_id In case undeployment is needed, the following command shall be executed: $ ant removeResourceGT4 -Ddai.service.path=path_to_service -Ddai.resource.id=dai_resurce_id

10. GridFTP • GSI security on control and data channels • Multiple data channels for parallel transfers • Partial file transfers • Third-party (direct server-to-server) transfers • Authenticated data channels • Reusable data channels • Command pipelining

11. Problem with GridFTP • Hard to find java examples • Authorization Problem • Authentication Problem • Security Mechanisms Installation Problem

12. CSCW Framework • Files of interest: • framework/server/filter/import_filter_sat.cc • framework/server/vef/geom_model.cc • New files added: • GridService.java • client.cpp

13. The Work on the Framework geom_model.cc MySql import_filter_sat.cc OGSA-DAI GridService.java Server.java client.cpp socket communication

14. Time Performances – Client

15. Time Performances – Server

16. To sum up… • Web Service successfully deployed • OGSA-DAI Service successfully deployed • Data queries successfully executed to a database • Data transfer from within the code • File transfer from within the code, with a system call to globus-url-copy command • The framework successfully connected with the java server that executes queries sent from this framework

17. Questions & Answers