P2P Distributed Computing Platform: Korea@Home

1. P2P Distributed Computing Platform:Korea@Home C.Y. ‘Connor’ Park chan@kisti.re.kr KISTI Supercomputing Center

2. Overview • Korea@Home (KatH) : A Software Platform for Distributed Computing using Volunteer Computer Resources • Features • Hybrid Peer-to-Peer architecture • Secure PKI-based Security and Digital Signature • Web Services with SOAP messaging 16th APAN Meetings, BUSAN, KOREA

3. Motivation • To take advantage of and stimulate ‘Advanced Network Infrastructure in Korea’ • To meet the growing needs of computing power for applications • Funded by ‘Ministry of Information and Communication (MIC)’ 16th APAN Meetings, BUSAN, KOREA

4. Infrastructure • Over 10,000,000 Broadband network (xDSL, Cable) households - 2002. 11. • Over 58.4% of PCs with Pentium3+ 16th APAN Meetings, BUSAN, KOREA

5. Intention of Participation Korea@Home Understanding Intention of Providing Resources Providing with Compensation (7.2%) Don’t (2.9%) Don’t Know (33.3%) Well-Understanding (44.9%) Keep up Providing (59.5%) Providing later (30.4%) Understanding roughly (21.8%) • 67.7% of Netizen already know what is Distributed Computing and Korea@Home. • 89.9% of Netizen have intention of providing their PC resources. 16th APAN Meetings, BUSAN, KOREA

6. Science SETI@Home, climateprediction.net Life Science Folding@Home, FightAIDS@Home Cryptography Distributed.net, RSAttack576 Mathematics Mersenne Prime Search, Pi(x) Project Internet Grub, CycleTrader Financial MoneyBee Games ChessBrain Miscellaneous DALiWorld Similar Projects from http://www.aspenleaf.com/distributed/index.html 16th APAN Meetings, BUSAN, KOREA

7. Project History • 2002. 4. • MIC launchedthe pilot project ‘Korea@Home’ • Application : Virtual Screening for New Drug Design • 2002. 8. • First pilot production and test • Client/Server Architecture Model • 2002. 12. • Second pilot production and test • 2003. 4. • Regularize the project “P2P Internet-based Distributed Computing Platform Development” • 2003. 9. • Announcement of Hybrid P2P-style Distributed Computing Platform 16th APAN Meetings, BUSAN, KOREA

8. Cooperation Cooperation Cooperation Architecture Agent Agent Agent Distribution Distribution Internet Distribution Agent Distribution Subscription Job Request Large-scale Application Resource Management 16th APAN Meetings, BUSAN, KOREA

9. Design Goals • Application Developers (Job Requester) • Convenience • They should be able to use easily. • Flexibility • The platform is general enough to be used by various applications. • Correctness • The platform should return correct results. 16th APAN Meetings, BUSAN, KOREA

10. Design Goals • PC agents (Resource Providers) • Transparency • PC users are not disturbed in their own works. • Reliability • It’s reliable not to make any security and privacy problem. • Reward • There is any kind of compensation, even just in mind. 16th APAN Meetings, BUSAN, KOREA

11. Design Goals • Platform • Scalability • Performance should be improved according to the growth of agents. • Adaptability • It should put up with the dynamic features of Internet. 16th APAN Meetings, BUSAN, KOREA

12. Implementation Choices • Web Services • SOAP messaging over https • Request-Response Model • It is Agents’ duty to make most decisions. • PKI-based certification and Digital Signature for files Make server as simple as possible, and Make PC agents more intelligent 16th APAN Meetings, BUSAN, KOREA

13. Functional Classification • Resource Management • Authentication, Certification • Simple accounting • Scheduling and Job distribution • Job distribution with hybrid P2P style • Result gathering • Client Management • Client authentication • Application preparation to work • Digital signing • Result returning to client 16th APAN Meetings, BUSAN, KOREA

14. Agent Agent Agent Agent KatH Server Job Distribution • Authentication • Working Specification Request • Is there any job for me to work? • Who has the job data? Internet • Getting data, working, and returning result to server 16th APAN Meetings, BUSAN, KOREA

15. Networking Issues • Network Security • DoS, Spoofing, Sniffing, … • Variable Connection • Dial-up, cable, xDSL, T1/E1, … • IPv6, WiFi, Bluetooth, … • Network Unobtrusiveness • Background/shared communication • Transparency (Firewall/NAT) 16th APAN Meetings, BUSAN, KOREA

16. 2002 Pilot Projects • Application : Virtual Screening for New Drug Design • Client-Server Architecture • An Agent • Receives about 400KB-size file • Executes during 20 minutes per working unit • Returns about 190KB-size file • Total number of working job units : 50,000 16th APAN Meetings, BUSAN, KOREA

17. Calculating Active Site PMI Calculating Ligand PMI Structure Analysis Virtual Screening Target Protein Chemical DB Share Analysis Clinical Demo Mass-produce New Drug Disease Protein Ligand DB Virtual High-Throughput Screening + + Client 1 + + Client 2 Server + + Looking for Drug Candidate Client 3 Internet 16th APAN Meetings, BUSAN, KOREA

18. Experimental Results • 1st Test • 1,217 installed agents • 2002.8.22-9.2 • Max 53.5 Gflops / Avg. 31.78 Gflops • 2nd Test • 6,472 installed agents • 2003.2.6-2.14 • Max 644 Gflops / Avg. 470.6 Gflops ※ World Top Rank 124 - 629.7 Gflops: IBM xSeries Cluster Xeon 2.8 GHz - Myrinet/ 192 (from http://www.top500.org, 2003.6) 16th APAN Meetings, BUSAN, KOREA

19. 2003 Progresses • P2P data distribution • New Applications • Virtual Screening for New Drug Design • Global Risk Management for financial investment • 3D image rendering • Supplementary plug-in • Remote backup service 16th APAN Meetings, BUSAN, KOREA

20. Future works • Make agents more intelligent with P2P • MPI-like API for application developer • Fault-tolerance : checkpointing & rollback recovery • IPv6 enables • Open-Source 16th APAN Meetings, BUSAN, KOREA

21. Thanks a lot! ^^ chan@kisti.re.kr 16th APAN Meetings, BUSAN, KOREA