1 / 32

IDGF I nternational D esktop G rid F ederation

IDGF I nternational D esktop G rid F ederation. PORTING APPLICATION TO THE BOINC DESKTOP GRID: ISA RAS EXPERIENCE Mikhail Posypkin Oleg Zaikin Nikolay Khrapov. DEGISCO is supported by the FP7 Capacities Programme under contract nr RI-261561. TALK OUTLINE.

roxanne-jovan
Download Presentation

IDGF I nternational D esktop G rid F ederation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. IDGFInternationalDesktopGridFederation PORTING APPLICATION TO THE BOINC DESKTOP GRID: ISA RAS EXPERIENCE Mikhail Posypkin Oleg Zaikin NikolayKhrapov DEGISCO is supported by the FP7 Capacities Programme under contract nr RI-261561.

  2. TALK OUTLINE • Introduction to the Russian Chapter • Our BOINC and combined infrastructures • OPTIMA@home project: using GenWrapper • SAT@home project: using DC-API • Performance Assessment • Lessons learnt

  3. Who we are • Institute for Systems Analysis of RAS (ISA RAS) www.isa.ru (founded in 1976) • Centre for Grid Technologies and Distributed Computing: • Desktop and Service Grids • Service-orientedScience • Parallel algorithms • Numerical methods in optimization • Partner in the DEGISCO project • Founding member of IDGF

  4. The Goals of Russian Chapter • Help Russian research and industry teams to develop, deploy and maintain their desktop-grid distributed applications • Maintain DCI infrastructures for our projects and for other organizations • Provide courses and tutorials on desktop grids and volunteer computing for Russian academic and industrial community • Promote Russian BOINC projects • Explain the mission of IDGF and benefits of the membership

  5. Our Desktop Grid Infrastructure BOINC Educational Infrastructure boinc-edu.isa.ru BOINC Test Infrastructure boinc-test.isa.ru BOINC Production Infrastructure boinc.isa.ru, sat.isa.ru • Based on SZTAKI Desktop Grid Package

  6. The Typical Pass Lots of (student) projects Netmax OPTIMA@home SAT@home

  7. Production BOINC Infrastructure • Currently we have two projects running in production: OPTIMA@home (0.5 Tflops real performance)and SAT@home (1.3 Tflops real performance) • Two ways of application porting: • GenWrapper (OPTIMA@home) • DC-API (SAT@home) = 3 x 48-core servers

  8. Service Grid Infrastructure RU-ISA-CGTDC : grid.isa.ru 4 nodes: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 4 GB RAM,640 GB Disk space

  9. Combined Infrastructure OPTIMA@HOME EGI Desktop Grid VO

  10. OPTIMA@home • OPTIMA@HOME is a research project that uses Internet-connected computers to solve challenging large-scale optimization problems. The goal of optimization is to find a minimum (or maximum) for a given function. • Currently we use Monotonic Basin Hopping Method implemented in the BNB-Solver framework

  11. Monotonic Basin-Hopping Method “seed”- starting point MNI controls the run-time Maximal No Improve (MNI)

  12. Distributed Version of Basin-Hopping Generate Seeds Compute Results Collect and Process Results (find minimum)

  13. Implementation BOINC Core Client BOINC Server GenWrapper BNB-Solver Server Workstation Client Workstation

  14. GenWrapper- A generic BOINC wrapper for legacy applications • Free tool developed by SZTAKIhttp://genwrapper.sourceforge.net/ • GenWrapper is a generic BOINC wrapper for legacy applications utilizing GitBox (a variant of BusyBox): Use POSIX like shell scripting and built-in commands like tar, awk, sed, zip, etc. to control and execute your legacy Desktop Grid application.

  15. GenWrapper script for OPTIMA@home (on the client side) IN=`boinc resolve_filename in` OUT=`boinc resolve_filename out` BNBAPP=`boinc resolve_filename bnbss` ./"${BNBAPP}" "${IN}" "${OUT}"

  16. On the server side • Generate and store input files • Use create_work to submit workunits • Use sample_assimilator (shipped with BOINC) to collect results in a folder • Use scripts to process results

  17. More complex scenario Generate Starting Points Compute Results Collect Results and generate new workunits

  18. More elaborate version • We use a perl script that • runs as a periodic task • processes results , generates and submits new workunits • uses found local minima as starting points for new workunits Adding periodic task (in config.xml): <task> <cmd> ma.pl </cmd> <period> 30 minutes </period> <output> ma.out </output> </task>

  19. Resume: GenWrapper • GenWrapper is perfect for porting “legacy” applications • You can organize complex workflows with GenWrapper using BOINC periodic tasks • If you need more control over your application use DC-API

  20. SAT@home project • SAT@home is a research project that uses volunteer computing to solve hard and practically important problems that can be effectively reduced to Boolean satisfiability problem. • Applicability • discrete functions inversion problems • cryptography • discrete optimization • bioinformatics • Problems that being solved currently: • Problems of inversion of some cryptographic functions used in stream ciphers are being solved.

  21. The SAT@home approach Desktop grid decision Original problem SAT problem decompose CNF in DIMACS format solve Satisfying assignment or UNSAT CNF encoding of the original problem is decomposed into a family of CNFs which are "simpler" for SAT solvers. For finding "good" parameters of decomposition we use special technique of predictive functions which take into account peculiarities of the original problems.

  22. SAT@home Implementation • Project was implemented using BOINC platform and DC-API library (http://www.desktopgrid.hu). • Server part of the application terminates the experiment as soon as the 1st satisfying assignment found • Client part of the application is based on publically available SAT solvers minisat 1.14.1 and minisat 2.0 (http://minisat.se) modified to take into account peculiarities of an original problem and its CNF encoding • Control points

  23. DC-API • DC-API applications consist of two major components: a master application and one or more client applications. • The master application usually runs as a daemon, but it is also possible to write a master that runs periodically. Master generates workunits, collects and processes results. • Client applications are simple sequential programs that take their input from the master, perform some computation on it and produce some output. • Free: http://www.desktopgrid.hu

  24. Resume: DC-API • Flexible • C-based • Gives comprehensive control over your application • Much easier than BOINC API

  25. GenWrappervs DC-API: when to use what? Gen Wrapper DC-API You write application from scratch Your application is written in C/C++ You need complex distributed scenario and fine control over your application You target several DG platforms: OurGrid, Condor, etc. • You have a big complex application • You have a non-C (C ++) application • You don’t need a fine control over your distributed application

  26. Performance evaluation: SZTAKI tools

  27. Performance evaluation: ISA RAS tools

  28. Performance evaluation: ISA RAS tools Tuesday, November 8, 2011 Session S8 16:15   Assessing the Performance of Desktop Grid Applications, A. Afanasiev, N. Khrapov, and M. Posypkin

  29. Lessons Learnt • Choose proper technology (GenWrapper or DC-API) • Invest to advertisement (forums, statistics etc.) • Evaluate and analyze your performance (use tools) • Be careful with your donors – always respond their questions and don’t ignore their complaints

  30. IDGFInternationalDesktopGridFederation http://desktopgridfederation.org/ Globe adapted from http://upload.wikimedia.org/wikipedia/commons/f/fa/ Globe.svg

More Related