180 likes | 326 Views
GEM Portal and SERVOGrid for Earthquake Science. PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics Indiana University, Bloomington IN 47404 http://grids.ucs.indiana.edu/ptliupages. Solid Earth Research Virtual Observatory Grid.
E N D
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics Indiana University, Bloomington IN 47404 http://grids.ucs.indiana.edu/ptliupages
Solid Earth Research Virtual Observatory Grid • A number of simulation methods for studying earthquakes are being developed by GEM consortium including: • Simplex, Disloc (JPL) • Virtual California (UC-Davis) • PARK codes (Brown) • As codes become more robust and accepted, problems emerge: • Need to manage information about distributed data sources: multiple databases, sensors, simulated data. • Need to organize, manage information about multiple code installation sites. • Need to simplify access to data, use of codes, and use of visualization/analysis tools for broad range of users • Need to link together • NASA funded activity to develop SERVOGrid Interoperability framework
RepositoriesFederated Databases Sensor Nets Streaming Data Database Database Analysis and Visualization Loosely Coupled Filters Closely Coupled Compute Nodes SERVOGrid Architecture
Grid Web Service and Portlet based Portal Architectures • Web services are part of a broad industry and academic initiative to build distributed computing infrastructure around existing standards (HTTP, XML, etc). • Web services can be used to provide lightweight service descriptions and send messages between components in XML. • OGSA (Open Grid Service Architecture) builds on basic Web Services • Component model for Grid replacing/building on CORBA, COM, Enterprise Javabeans etc. • Portlets provide component model for user interfaces
Computing Portal Grid Web Services • We have built a suite of general purpose Grid Web services for managing distributed applications. • Core Computing services define general purpose functions: • Ex: job submission, file transfer, job monitoring, management of jobs and results • Described as a GridShell as plays same role to Grid that Shell does for UNIX on a single machine • Application Grid Web services include metadata about applications. • Built on top of core services. • Original application NOT changed • We have developed a toolkit that allows one to convert general software packages into Grid Web Services and manage application collections
Portal Services SystemServices SystemServices Application Service Application Metadata Middleware SystemServices SystemServices SystemServices Raw (HPC) Resources Actual Application Database UserServices GridComputingEnvironments “Core”Grid
Application Grid Web Services • AGWS are designed to make scientific applications (i.e. earthquake modeling codes) into Grid Resources • AGWS services are described by two XML Schemas: • Abstract descriptors describe application options. Used by the application developer to deploy his/her service into the portal. • Instance descriptors describe particular user choices and archive them for later browsing and resubmission.
Browser Interface JSP + Client Stubs DB Service 1 Job Sub/Mon And File Services DB Service 2 JDBC JDBC DB DB Operating and Queuing Systems Host 1 Host 2 Host 3
GEM Portlets and Portal Stacks • User interfaces to GEM services (Code Submission, Job Monitoring, File Management for Host X) are all managed asportlets. • Users, administrators can customize their portal interfaces to just precisely the services they want. Aggregation Portals User facing Web Service Ports Message Security, Information Services Application Grid Web Services Core Grid Services
File Selector Screenshot • Users can view files on remote hosts • Shown is user file list for host noahsark. • Host solar is also shown. • Files can be uploaded or downloaded between PC and remote host. • Files may be crossloaded between two remote hosts. • Same interface definition may be used to access databases.
File management Tabs indicate available portlet interfaces. Lists user files on selected host, noahsark. File operations include Upload, download, Copy, rename, crossload
Application Selection Screen Shots • Users can select from available codes (Simplex, Disloc, various VirtualCalifornia) • Users also select from available hosts for particular code (grids, noahsark, solar shown). • Selecting solar (Sun 64 Node E10000) prompts user for information needed to use PBS script generating service.
User Application Selection and Submission Generate script for job submission Select desired application and host
Application Administrator Interfaces • Application Administrators deploy and manage applications • Update screen shows various application and host parameters that are set by the user. • These are used to generate user interfaces for the selected codes.
Administer Grid Portal Provide information about application and host parameters Select application to edit
Futures I: General Capabilities • System builds on Gateway Portal developed for NCSA Alliance and DoD HPCMO. This project intends to: • Integrate portlets from other groups in collaborations (common interoperability framework for all tiers) • Continue developing message-based security system (currently available as demonstration) that signs SOAP messages. • Integrate AGWS and Results Manager with arbitrary Schema Wizard/Storage/Browser system used in Indiana XML newsgroups. • Add negotiation capabilities to Web Services for version control • Track evolving OGSA service standards and implementations. • Add dynamic information service and monitoring capabilities for transient Web Services. • Distributed, ant-based tools to simplify service upgrades of distributed servers (and simplify our lives).
Futures II: SERVOGrid • Assist with design of common data format and associated tools for GEM codes. • i.e. SERVOGrid Object Model defined in XML • Add support for service linkage (workflow) for specific GEM applications • e.g. Disloc<->Simplex interoperation). • Add support for Web-based visualization with portlet interface. • SERVOGrid portal will be publicly available