1 / 23

Legacy Code Wrapping Yongwei WU Tsinghua University

Legacy Code Wrapping Yongwei WU Tsinghua University. outline. Problem statement Characteristics Objective Implements Features added to the GCM Usage Application Future Work. Problem Statement.

dom
Download Presentation

Legacy Code Wrapping Yongwei WU Tsinghua University

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Legacy Code WrappingYongwei WUTsinghua University

  2. outline • Problem statement • Characteristics • Objective • Implements • Features added to the GCM • Usage • Application • Future Work Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  3. Problem Statement • Legacy codes written in Fortran or C/C++ using MPI has to be usable if the objective is to build an effective grid component framework; • In many cases it is not feasible or affordable to rewrite existing code; • Using existing works is most important for IT development; Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  4. Objective • Objective: • To develop techniques and methods for wrappinglegacy code as GCM components which can run over grid without re-engineering the code, or even access the source files; • Legacy code component will be a module with standardized GCM description, and can be manipulated by tools for composition and deployment; Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  5. Characteristics The general characteristics of legacy code are as follows: • The source code is not available. • The program is poorly documented and the necessary expertise to do any modifications has long left the organization. • The application has to be ported onto the grid within the shortest possible time and smallest effort and cost. • The functionalities are offered to partner organizations but the source is not. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  6. Implements(1/5): Actions According to our research, grid-enabling legacy code includes the following actions: • For the legacy code, provide some APIs in a standard interface to describe the legacy code attributes, such as the command line format and parameters. • For the related file operations, define some APIs in the interface to transfer the files and set the files’ attributes. • For the resource requirement of the legacy code, include it in the “GCM application description”. • For the running process of the legacy code, define the needed server and client interfaces to manipulate and control the legacy code. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  7. Implements (2/5) : The architecture of the Legacy Code Component The architecture of the legacy code component Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  8. Implements (3/5) : Description of the Legacy Code • Extending the ADL • Not a flexible and extensible solution. • First version • Providing some API in a standard Interface • Have to create a component with the defined factory (LegacyComponent class). • Set attributes with the AttributeController. • Our current solution Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  9. Implements (4/5) : Related File Operations • Reuse the file transfer mechanism provided by the ProActive middleware • ProActive File Transfer Protocol (PFTP), SSH, RSH and Nordugrid • File Transfer will take place before the deployment of the component or after the successful execution of the legacy code at the target computing node • Have to set the permissions of the related files Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  10. Implements(5/5) : Execution Management The execution status transition of the legacy code Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  11. Features added to the GCM(1/5) :API describing the Legacy Code package org.tsinghua.gcm.legacyComponent.attribute public interface LegacyComponentAttributes extends AttributeController { public void setComment (String value); public void setExecutable (String value); public void setParameters (String value); } Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  12. Features added to the GCM(2/5) : The Running Process of the Legacy Code package org.tsinghua.gcm.legacyComponent.legacyCode public interface LegacyCodeControllerInterface { public LegacyCodeResult startLegacyCode(); public LegacyCodeResult reStartLegacyCode(); public boolean killLegacyCode(); public String getStatus(); public void setLegacyCodeCommand (String arguments); } Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  13. Features added to the GCM(3/5) : API for Related Files Operation package org.tsinghua.gcm.legacyComponent.relatedfile public interface LegacyComponentAttributes extends AttributeController { //only transfer the file from the local to the remote node where running the legacy code. public void fileTransfer (File srcFile, File dstFile); public void fileTransfers (File[] srcFiles, File[] dstFiles); //set the relatedfile’s permissions, such as the “read”,”write” or “execute” public void setFilePermission(File file, Permission permission); public void setFilePermissions(File[] file, Permission[] permission); public void setFilePermission(String permission);  //delete the no-useful files after running the legacy code successfully public void setFileDelete(File file, FileDelete delete); public void setFileDeletes(File[] file, FileDelete[] delete); public void setFileDeletes(String delete);  } Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  14. Features added to the GCM(4/5) : Resource Requirement of the Legacy Code • The definition of a virtual node in a “GCM application descriptor” file with the specification of the following elements: • operatingSystem • CPUArchitecture • CPUSpeed • CPUCount • memory • networkBandwidth • diskSpace Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  15. Features added to the GCM(5/5) : Wrap the Legacy Code to Component package org.tsinghua.gcm.legacyComponent //wrap the legacy code to Component public Interface LegacyComponent{ public Component newLegacyComponent(); } Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  16. Usage • An example implemented By API • An example implemented By ADL Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  17. Usage • BY API Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  18. Usage • BY ADL A common legacy code component ADL Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  19. Usage • BY ADL The base ADL file Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  20. Application: Bioinformatics • Belong to Scientific Computing Application • This Bioinformatics program can be divided into 3 sub program{CAP3，Tigr (Gene Sequence Assembly Tool) ,Blast (Sequence Alignment Tool)}, and they have natural parallel characteristics. Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  21. Application: Bioinformatics 1)Mapping & get Nodes (2)File transfer (3)Legacy code ->primitive Component by using API (4) primitive Component ->Composite Component(CC) (5)Component deployment (6) Composite Component1&2 are started parallel (7)In Node1&3, the component Cap3 in CC 1 and component Tigr in CC2 are working parallel. (8)When Cap3&Tigr finish their work ,they transfer the output files to node2&4 (9)The two Component Blast on node 2&4 begin to work (10)Return each result of the CC to the Result Integrate Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  22. Legacy Code Wrapping: Future work • Future Work • Add some APIs ,such as setStopCommandLine(), setPauseCommandLine() to make good use of the various of commands of legacy code. • Implement the request interface of LegacyComponent so that it can communicate with another component • Execute legacy code asynchronously to increase the efficiency of program Grid programming with components: an advanced COMPonent platform for an effective invisible grid

  23. The end Thanks Grid programming with components: an advanced COMPonent platform for an effective invisible grid

More Related