1 / 23

OurGrid ourgrid

OurGrid http://www.ourgrid.org. E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008. Overview. OurGrid Architecture Infrastructure Jobs Installing an OurGrid Site XMPP Server Peer Worker Broker Running Jobs References.

kare
Download Presentation

OurGrid ourgrid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. OurGridhttp://www.ourgrid.org E2GRIS1 Rafael Silva Universidade Federal de Campina Grande (Brazil) Itacuruça (Brazil), 2-15 November 2008

  2. Overview Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008 • OurGrid • Architecture • Infrastructure • Jobs • Installing an OurGrid Site • XMPP Server • Peer • Worker • Broker • Running Jobs • References

  3. OurGrid • OurGrid is an open, free-to-join, cooperative grid in which labs donate their idle computational resources in exchange for accessing other labs’ idle resources when nedeed • Applications Bag-of-Tasks (BoT) • However, a single OurGrid task may itself be a parallel tightly-coupled application (written in MPI, for example) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  4. Architecture Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  5. Infrastructure • Broker • Client interface for job submission • Worker • Executes the jobs submitted • Peer • Controls the donating and consuming of the machines • Discovery Service • Discover resources on the Grid • Network of Favors (NoF) • Resource share incentive • Prevent free riding • Peers that only consumes resources Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  6. Communication Infrastructure • Commune • Built on top of XMPP (Extensible Messaging and Presence Protocol). Thus, every communication between OurGrid components are intermediated by a XMPP server. • OpenFire Server (WildFire) • http://www.igniterealtime.org/downloads/index.jsp Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  7. Jobs • Job Description File (JDF) • Each job is a set of tasks, where each task can have three parameters: • Init • File list to be transferred to the worker • Remote • Command to be executed in the worker • Final • Retrieve the result of the task Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  8. Jobs (2) requirements: (os == windows) requirements: (mem == 1024) • Requirements • Actually, the OurGrid only has two types of requirements specification available: • Operating System • Memory Size Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  9. Jobs (3) put <local_path> <destination_path> store <local_path> <destination_path> • Types of Storage • $PLAYPEN (temporary storage) • $STORAGE (permanent storage) • Other Variables • $PROC • Contain the grid machine chosen to run the task • $JOB • Job unique number • $TASK • Task unique number (within a job) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  10. An example of a JDF file job : label : SimpleJob task : init : put Fat.classFat.class remote : java -cp . Fat 3 261147332 6819792792357414911 output-$JOB.$TASK final : get output-$JOB.$TASK output-$JOB.$TASK task : remote : hostname -f Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  11. Installing an OurGrid Site Two ways to configure: - text mode - gui mode • To install an OurGrid Site, it is only necessary to install the following services: • XMPP Server • Peer • Workers • Broker • In addition to these services, the only requirement is Java 1.5 or higher Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  12. Installing the XMPP Server • Download the openfire package from: • http://www.igniterealtime.org/downloads/index.jsp • Extract the tarball and start it • <openfire-directory>/bin/openfire start • Open your browser and type: • http://<your-openfire-server-ip>:9090 • And follow the instructions of the following link: • http://www.ourgrid.org/index.php?option=com_content&view=article&id=52&Itemid=2&lang=en#Anc_2 Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  13. XMPP Server Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  14. Peer Installation • $ unzip peer-<version>.zip • $ cd peer-<version> • $ sh peer gui • Download the peer package from the OurGrid’s website, uncompress it and start the graphical interface • Configuring the peer Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  15. Peer Installation (2) Adding Workers Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  16. Peer Installation (3) workerdefaults : copyTo : scp $localfile $machine:$remotefile remExec : ssh -x $machine $command copyFrom : scp $machine:$remotefile $localfile worker : OS : linux servername : xmpp.ourgrid.org username : worker-001 worker : OS : windows servername : xmpp.ourgrid.org username : worker-002 Site Description File (SDF) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  17. Peer Installation (4) Adding Brokers Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  18. Worker Installation • $ unzip worker-<version>.zip • $ cd worker-<version> • $ sh worker gui • Download the worker package from the OurGrid’s website, uncompress it and start the graphical interface • Then, configure the same variables again: • XMPP User Name • XMPP User Password • XMPP Server Name • IMPORTANT! • Put the public key of the peer in the “Worker Configuration” tab. Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  19. Broker Installation • $ unzip broker-<version>.zip • $ cd broker-<version> • $ sh broker gui • Download the broker package from the OurGrid’s website, uncompress it and start the graphical interface • Then, configure the same variables again: • XMPP User Name • XMPP User Password • XMPP Server Name Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  20. Broker Installation (2) peer: label: 127.0.0.1 username : peer-rafael servername : rs Now, it is necessary specify the peers the broker will be able to submit jobs Grid Description File (GDF) Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  21. Running Jobs • Demonstration Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  22. References • OurGrid web site • http://www.ourgrid.org • XMPP Community • http://www.xmpp.org • Openfire • http://www.igniterealtime.org/projects/openfire/index.jsp Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

  23. Questions… Itacuruça (Brazil), E2GRIS1, 2.11.2008 - 15.11.2008

More Related