1 / 46

PROGRESS Computing Portal

PROGRESS Computing Portal. Poznań Supercomputing and Networking Center (PSNC) Poland Cezary Mazurek. PSNC Activity. Operator of the Polish National Research and Education Network POL-34/622 Operator of the Poznań Metropolitan Area Network POZMAN HPC Center

river
Download Presentation

PROGRESS Computing Portal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. PROGRESS Computing Portal Poznań Supercomputing and Networking Center (PSNC) Poland Cezary Mazurek

  2. PSNC Activity • Operator of the Polish National Research and Education Network POL-34/622 • Operator of the Poznań Metropolitan Area Network POZMAN • HPC Center • Systems and Network Security Center • R&D Center for New Generation Networks, Grids and Portals

  3. Communication Application Computational Science Application Internet Access Aided Learning Application Distance Learning Application Environment Management Application Geographical information applications Portal(s) GRID-enabled Applications PIONIER National Programme Advanced Network Services (Middleware) Optical Network Advanced Research Specialized Infrastructure

  4. PIONIER Network

  5. PIONIER Projects • PROGRESS • Access environment to computational services performed by cluster of SUNs • iTV • System for providing an audio-visual stream over Polish Optical Internet enabling the interactive television • LDAP • Deployment of LDAP Protocol in the National Research and Education Network POL-34/622 • VLAB • High Performance Computing and Visualisation for Virtual Laboratory Applications

  6. PROGRESS • Duration: December 2001 – May 2003 • Deployment: June 2003-December 2003 • Project Partners • SUN Microsystems Poland • PSNC IBCh Poznań • Cyfronet AMM, Kraków • Technical University Łódź • Co-funded by The State Committee for Scientific Research (KBN) and SUN Microsystems Poland

  7. PROGRESS • Project is testbed oriented • Three bioX applications will be enabled within the grid-portal architecture • Two of them are already available • Distributed cluster of SF6800 is a pilot testbed installation • Dedicated channels through PIONIER network (1 Gb/s) will come in the 3Q2003 • Tools and services for grid processing and data management in PROGRESS grid-portal framework

  8. PROGRESS Architecture

  9. HTTP/HTTPS HTTP/HTTPS HTTP/HTTPS Webservice WebserviceFTP Grid FTP PROGRESS Communication Portal Service Provider Grid Broker SGE SGE

  10. PROGRESS • Pilot installation Poznan-Krakow • 3 SUN Fire 6800 • Poznań: SUN Fire Link • 2 Data Servers • Front-end for portal access • Distributed processing in distributed framework

  11. PROGRESS Testbed

  12. PROGRESS testbed Portal Server Frontend SGE EE HPC Cluster Tools Globus SGE EE HPC Cluster Tools Globus Computing Aplication Server Certification Server Oracle Aplication Server Certification Server Oracle Data management SRS Database SRS Database Data storage

  13. 1Gb/s Ethernet Fibre Channel Management PROGRESS testbed SF 6800 SF V880 SF 280R Fast Ethernet SE T3/T3+ SB 1000

  14. PROGRESS – BioX Applications • DNA Assembly BranchBound1 • DNA Assembly Heuristic2 • DNA Assembly Heuristic3 • Prediction of protein secondary structure - module A1 • Prediction of protein secondary structure - module A2 • Prediction of protein secondary structure - module B • Prediction of protein secondary structure - module C • Prediction of protein secondary structure - module D • Logical workflow applications: • LAD – learning: A1->B->C • LAD – testing: A2->D

  15. PROGRESS Architecture

  16. PROGRESS HPC Window • GRID user interfaces are independent of the information processing layer • bioX computational portal • Migrating Desktop application • The PROGRESS HPC Portal is the user interface for the PROGRESS grid access environment

  17. PROGRESS • 4 – tier architecture for grid-portal environment

  18. PROGRESS Service Provider

  19. SOAP Entity Beans Session Bean Content Provider Webservice SOAP/XML PROGRESS • Content Provider • Data presentation • User interaction • Service Provider • Realization of services functions • Services data storage and access ComputingPortal GRID Service Provider

  20. PROGRESS Portal • PROGRESS computational portal • Accessing applications collected in the application factory • Forming and running jobs • Accessing data stored in the Data Management System • Providing information services • The PROGRESS Portal is equipped with 5 portlets (content providers) interacting with the user on behalf of PROGRESS services. These portlets are: • My jobs • My data • News • Applications • Management

  21. PROGRESS Grid services • Job submission service • creating, building, submitting, monitoring execution and analyzing results of grid jobs (“My jobs” portlet) • Application management service • adding and configuring applications in the GSP application factory (“Applications” portlet); “virtual application” management under development • Provider management service • keeping up-to-date information on services available in the grid service provider (“Management” portlet) • Informational services • news service – reading short messages illustrated with web links (“News” portlet); multiple instances; other informational services under development – “Discussion”, “Links” portlets) • Data management • uploading and downloading files, file system tree management(“My data” portlet)

  22. Web services communication saveJob() getApplications() saveTaskOfJob() saveStdOfTask() submitJob() getUserJobs() getJobStatus() HPC Portal Grid Service Provider changeJobStatus() listUserDirectory() addUserFile() submitJob() Data Management System Grid Resource Broker getUserFileLocation()

  23. Authentication and access control • Authentication: username+password, LDAP based user database • Authorization - 2 levels: • portlet access control – performed by the portal framework • grid services authorization – RAD based authorization module • Single Sign-On – enabled by the identity server

  24. Logon Method invocation Request Token validation Authentication Authorization of resource access Authentication, authorization and SSO in PROGRESS Grid service provider Portal Identification server RAD

  25. PROGRESS Grid broker • Grid Broker in Progress: • Job submission, monitoring and controlling • Different scheduling and resource management strategies • Flexible job description language (XRSL) • Heterogeneous and service based environment

  26. PROGRESS Grid Broker

  27. Grid broker + request description XRSL (XML/RSL) Portal Resources & Services Broker Globus Information System (GIS) SGE Resources Monitoring Resources

  28. PROGRESSData Management System • Provides seamless access to data and information for grid computing • Uses metadata repository for describing stored data • Stores data on various media such as files, tapes and databases

  29. Clients Portal Grid broker Migrating desktop PROGRESS Data Management System Metadata Management WS Mirror & Proxy Data Broker SRS Data Storage Data Storage Data Storage GASS FTP Grid FTP (...)

  30. PROGRESS Security • Intrusion Detection System (IDS) • Advanced security mechanisms that are destined to detect, possibly in real time, unauthorized security attempts, security breaches and attacks. • One of the tasks realized in the PROGRESS project is VALKYRIE IDS for Solaris operating system. • VALKYRIE IDS: • is a host based system, • passively monitors protected infrastructure, • uses misuse detection approach for analysis, • works continuously.

  31. VALKYRIE IDS • Module for monitoring operating system events (kernel level module) • Expert system module for analyzing system events stream and for attack detection • GUI console for system operator

  32. PROGRESS Security Firewall System Portal protection IPLANET Oracle Solaris globus PCSS SCM grid engine Expert System Module GUI

  33. PROGRESS Migrating Desktop • Alternative user interface to GRID resources; • Layout analogous to „windows based” operating systems GUI, like e.g. Windows, KDE, Gnome, etc. – can be more intuitive for some users; • Possibility of working with different grid projects (integrated also with CrossGRID project co-funded by EU);

  34. Migrating Desktop Functionality • Graphic User Interface (GUI) management; • User profile management; • File transfer management; • Job configuration and submition; • Job execution monitoring; • Handling links to local files and applications; • Handling links to remote files;

  35. Migrating Desktop – main window

  36. PROGRESS PROGRESS at Supercomputing 2002, Baltimore, USA

  37. PROGRESSPortal

  38. PROGRESS – job list

  39. PROGRESS – job menu

  40. PROGRESS – job tasks

  41. PROGRESS – task requirements

  42. PROGRESS – data management

  43. PROGRESS – application factory

  44. PROGRESS - news

  45. PROGRESS • Conclusions • The PROGRESS project has provided components and services for flexible grid-portal environment, which might be deployed in other projects and environments • PROGRESS team has been working on additional functionality for Solaris OS in the area of checkpointing and security

  46. PROGRESS Thank you ! http://progress.psnc.pl/ http://progress.psnc.pl/portal mazurek@man.poznan.pl

More Related