1 / 12

Workflow Template Generation

Detailed guide on how to create and utilize workflows templates efficiently using proper examples. Includes steps on saving, decompressing, defining parameters, applying macros, and submitting commands. Temporary solutions are also provided for ongoing issues during the process.

gwessel
Download Presentation

Workflow Template Generation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Workflow Template Generation Haw to

  2. Steps Hand Made Preparation • Make proper set of WF examples on Portal • Save it to a local directory • Decompress it • Make a Template Directory of it (TD) • Define the Table of Actual Parameters TAP • Apply the Macro Generator to gain Destination DirectoryMG( TD,TAP) -> DD • Apply the Directory Compress And Upload Program • Start the Submit All Command on the Portal

  3. What should be parameter?

  4. Where are these Parameter? • <wf>_files.wrk -> <wf_dest>_files.wrk<wf_dest>,<ri>,<fi,j> • <JOB>.grid<voi> • .<JOB>.desc<voi>,<ri> • <JOB>/<JOB>.jdl <voi>,<ri>,<fi,j>,<ei>

  5. Resource RemoteFile <wf>_files.wrk workflow "<<wf_dest>>" {"MultipLOC" 2 "MultipRemLoc" 1 OFFLINE "Copyrem" 1 "MultipLOC" 1 OFFLINE} {"Copyrem" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Copyrem/CopyAndTime" {""}"LINUX" {"<<r1>>"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/Copyrem/0/INPUT" (file_type=local;original_path="D:\A-TEST\I1") PERMANENT INPUT 1 "<<f11>>" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/OUTPUT") PERMANENT OUTPUT"MultipLOC" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipLOC/multiply.exe" {""}"LINUX" {"<<r2>>"} 0 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipLOC/0/INPUT1" (file_type=local;original_path="D:\A-TEST\I1") PERMANENT INPUT 1 "<<f21>>" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/INPUT2") PERMANENT INPUT 2 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipLOC/2/OUTPUT" (file_type=local;original_path="OUTPUT") PERMANENT OUTPUT "MultipRemLoc" SEQ_PORTAL (is_instrumented=false;monitor=off) "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipRemLoc/multiply.exe" {""}"LINUX" {"<<r3>>"} 0 "<<f31>>" (file_type=remote;local_path="/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/INPUT1") PERMANENT INPUT 1 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipRemLoc/1/INPUT2" (file_type=local;original_path="") PERMANENT INPUT 2 "/home/krisztian/pgportal/portal_work/users/hermann/<<wf_dest>>_files/MultipRemLoc/2/OUTPUT" (file_type=local;original_path="OUTPUT") PERMANENT OUTPUT} New FW name

  6. <JOB>.grid <<vo1>>

  7. <JOB>.desc hermann Indirect_REMOTE_Template Copyrem <<vo1>><<r1>> false

  8. <JOB>/<JOB>.jdl [ VirtualOrganisation = "<<vo1>>"; Executable = "Copyrem.sh"; JobType = "Normal"; StdOutput = "std.out"; StdError = "std.err"; InputSandbox = {"CopyAndTime", "Copyrem.sh","0/INPUT", "info.tar.gz" }; OutputSandbox = {"std.out", "std.err", "std.log"}; OutputData = { [ OutputFile = "OUTPUT"; LogicalFileName = "<<f11>>“ ] }; Environment = {<<e1>>}; RetryCount = 3; Requirements = other.GlueCEInfoHostname == "<<r1>>"; ]

  9. Table of Actual Parameters

  10. Haw To Generate Tab ? • Fill the Excell Table • When Save as, select Type : Text(Tab delimited)

  11. Haw to call the Macro Generator ? public WorkflowMacroFactory(String templateDirPath, String tapDirPath, String destinationDir, boolean toUNIX) A test main program calls this by default parameters: new WorkflowMacroFactory( "d:\\A_A_WorkflowRepository\\TEMPLATES\\DecompressedTemplates", "d:\\A_A_WorkflowRepository\\TEMPLATES\\TAP_newComplex.txt", "d:\\A_A_WorkflowRepository\\TOM", false); External call: Java – Gener.jar <TD> <TAP> <DD>

  12. Apply the Directory Compress And Upload Program • Under construction • Temporary problems:- Zip –Unzip sensitive to OS- Upload should bypass WF Editor, because SAVE operation of WE overwrites <JOB>/<JOB>.jdl files

More Related